Jul 06 19:51:00.518641 ip-10-0-142-134 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:51:00.838847 ip-10-0-142-134 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:51:00.838847 ip-10-0-142-134 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:51:00.838847 ip-10-0-142-134 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:51:00.838847 ip-10-0-142-134 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:51:00.838847 ip-10-0-142-134 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:51:00.840907 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.840813    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:51:00.844434 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844417    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:51:00.844434 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844433    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844438    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844442    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844445    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844455    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844459    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844462    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844466    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844469    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844471    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844474    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844476    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844479    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844481    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844484    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844486    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844489    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844491    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844494    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844497    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:51:00.844512 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844499    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844502    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844504    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844506    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844509    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844511    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844514    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844518    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844522    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844525    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844528    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844531    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844533    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844536    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844539    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844543    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844546    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844549    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844551    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:51:00.844972 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844554    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844556    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844559    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844562    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844564    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844567    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844569    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844571    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844574    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844576    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844578    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844580    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844583    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844587    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844590    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844593    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844597    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844600    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844603    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:51:00.845539 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844606    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844609    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844611    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844614    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844616    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844618    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844621    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844623    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844626    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844628    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844630    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844633    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844635    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844637    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844640    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844643    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844646    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844648    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844651    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844654    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:51:00.846004 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844657    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844659    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844661    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844664    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844666    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844668    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844671    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844673    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844677    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844680    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844682    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844686    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844688    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844691    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844693    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844696    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844700    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844702    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844705    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.844707    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:51:00.846529 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845416    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845424    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845427    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845429    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845433    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845435    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845438    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845440    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845443    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845446    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845449    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845452    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845455    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845458    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845460    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845463    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845466    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845468    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845471    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:51:00.847006 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845474    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845477    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845479    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845482    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845484    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845487    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845489    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845492    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845494    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845497    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845499    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845502    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845504    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845507    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845511    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845514    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845517    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845519    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845522    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:51:00.847488 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845524    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845526    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845529    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845531    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845534    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845536    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845539    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845541    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845546    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845550    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845553    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845556    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845558    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845561    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845564    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845567    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845569    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845572    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845574    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:51:00.847943 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845577    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845579    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845582    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845585    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845587    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845589    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845592    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845594    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845597    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845599    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845601    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845603    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845606    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845608    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845612    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845614    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845616    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845619    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845622    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845625    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:51:00.848431 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845627    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845630    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845633    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845635    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845637    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845642    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845645    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845648    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845650    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845653    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845656    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845658    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845661    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845663    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845666    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845669    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845671    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845674    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845676    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845679    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:51:00.848920 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845681    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.845683    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846049    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846053    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846056    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846059    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846061    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846064    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846066    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846069    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846073    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846075    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846078    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846081    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846083    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846086    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846088    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846091    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846093    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846096    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:51:00.849413 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846098    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846101    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846103    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846106    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846108    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846110    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846113    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846115    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846117    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846120    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846123    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846125    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846128    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846131    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846134    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846137    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846139    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846142    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846144    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:51:00.849924 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846146    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846149    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846151    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846154    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846157    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846160    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846163    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846166    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846169    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846171    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846173    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846176    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846178    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846181    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846183    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846186    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846188    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846190    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846193    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846195    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:51:00.850388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846198    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846200    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846203    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846207    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846210    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846213    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846215    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846218    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846220    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846223    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846225    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846228    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846230    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846232    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846235    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846237    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846240    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846243    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846246    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846248    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:51:00.850912 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846251    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846253    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846255    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846258    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846260    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846262    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846265    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846267    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846270    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846272    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846275    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846277    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846279    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846282    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846286    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846289    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846292    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846295    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846297    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:51:00.851412 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846300    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846303    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846306    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846391    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846408    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846414    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846418    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846423    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846426    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846430    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846435    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846438    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846441    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846444    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846447    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846450    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846453    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846456    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846459    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846461    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846464    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846470    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846472    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846475    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:51:00.851863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846478    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846481    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846485    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846488    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846491    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846494    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846497    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846500    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846503    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846505    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846508    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846512    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846516    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846518    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846521    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846526    2581 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846529    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846533    2581 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846537    2581 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846542    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846545    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846548    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846551    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846554    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846557    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:51:00.852491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846560    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846562    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846565    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846568    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846571    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846574    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846576    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846579    2581 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846583    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846585    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846588    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846591    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846594    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846597    2581 flags.go:64] FLAG: --help="false"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846600    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-134.ec2.internal"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846603    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846605    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846608    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846611    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846614    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846617    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846619    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846624    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:51:00.853104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846626    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846629    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846632    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846636    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846639    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846642    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846645    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846648    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846650    2581 flags.go:64] FLAG: --lock-file=""
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846653    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846656    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846659    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846664    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846666    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846669    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846672    2581 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846675    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846678    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846680    2581 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846683    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846687    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846689    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846693    2581 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846696    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846699    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:51:00.853791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846702    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846704    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846707    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846710    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846712    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846719    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846724    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846727    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846730    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846732    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846738    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846742    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846746    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846749    2581 flags.go:64] FLAG: --port="10250"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846751    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846754    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0af534f9fac2620f5"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846757    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846760    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846763    2581 flags.go:64] FLAG: --register-node="true"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846766    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846769    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846772    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846774    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846777    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846780    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:51:00.854533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846783    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846786    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846789    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846791    2581 flags.go:64] FLAG: --runonce="false"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846794    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846797    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846799    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846802    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846805    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846808    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846811    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846813    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846816    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846820    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846823    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846825    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846828    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846831    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846835    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846840    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846844    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846847    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846851    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846854    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846856    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:51:00.855555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846859    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846861    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846864    2581 flags.go:64] FLAG: --v="2"
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846868    2581 flags.go:64] FLAG: --version="false"
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846872    2581 flags.go:64] FLAG: --vmodule=""
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846876    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.846879    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.846996    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847000    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847003    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847006    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847009    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847012    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847015    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847018    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847020    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847022    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847025    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847027    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847030    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847033    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:51:00.856253 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847036    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847038    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847042    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847045    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847050    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847053    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847055    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847058    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847061    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847064    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847067    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847069    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847072    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847074    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847076    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847079    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847081    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847084    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847086    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847088    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:51:00.856857 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847091    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847093    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847095    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847098    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847100    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847102    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847105    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847107    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847109    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847112    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847114    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847118    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847121    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847123    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847126    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847129    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847132    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847135    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847137    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847139    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:51:00.857336 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847142    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847145    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847147    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847149    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847152    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847154    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847157    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847159    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847161    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847164    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847166    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847168    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847171    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847173    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847175    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847178    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847180    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847183    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847185    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847188    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:51:00.857853 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847190    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847194    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847197    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847201    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847204    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847206    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847209    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847211    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847215    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847217    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847220    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847224    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847227    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847230    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847233    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847236    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847239    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847241    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847244    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:51:00.858338 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847246    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847249    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847251    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847254    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847256    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.847259    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.847975    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.856924    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.856942    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.857633    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.857641    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857701    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857707    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857710    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857713    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:51:00.858820 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857716    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857720    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857724    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857727    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857730    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857733    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857736    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857738    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857741    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857744    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857748    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857751    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857754    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857756    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857759    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857762    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857764    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857767    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857769    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:51:00.859195 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857772    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857775    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857777    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857780    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857783    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857785    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857788    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857791    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857794    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857796    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857799    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857801    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857803    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857806    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857809    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857811    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857813    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857816    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857818    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857820    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:51:00.859670 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857823    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857825    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857827    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857830    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857835    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857838    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857841    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857844    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857846    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857849    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857852    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857854    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857857    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857859    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857862    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857865    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857867    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857870    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857873    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857876    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:51:00.860188 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857878    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857881    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857883    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857886    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857888    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857890    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857893    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857895    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857897    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857900    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857902    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857905    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857907    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857910    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857912    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857915    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857918    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857921    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857923    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857926    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:51:00.860822 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857928    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857931    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857933    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857936    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857938    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857941    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857943    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857946    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857948    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857950    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857953    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857956    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857958    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857961    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857963    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:51:00.861296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.857966    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.857971    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858112    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858117    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858120    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858123    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858126    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858129    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858132    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858135    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858137    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858140    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858142    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858145    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858148    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:51:00.861669 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858151    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858153    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858156    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858158    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858160    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858163    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858165    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858168    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858170    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858172    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858175    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858177    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858180    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858183    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858185    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858188    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858190    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858193    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858196    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858199    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:51:00.862046 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858203    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858206    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858208    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858211    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858213    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858216    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858220    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858223    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858226    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858229    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858232    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858235    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858241    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858245    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858247    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858250    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858252    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858255    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858257    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:51:00.862547 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858260    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858262    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858265    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858267    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858270    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858272    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858275    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858277    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858280    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858282    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858285    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858287    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858290    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858293    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858296    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858299    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858302    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858304    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858307    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:51:00.862997 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858310    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858312    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858314    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858317    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858320    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858323    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858325    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858329    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858331    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858334    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858336    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858339    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858341    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858344    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858347    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858350    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858352    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858355    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858357    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858374    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:51:00.863515 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858376    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858379    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858381    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858384    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858386    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858389    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858391    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:00.858394    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.858404    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.858536    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.862102    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.863232    2581 server.go:1019] "Starting client certificate rotation"
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.863334    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:51:00.863992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.863390    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:51:00.865528 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.865514    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:51:00.866872 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.866853    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:51:00.878076 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.878055    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:51:00.881812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.881790    2581 log.go:25] "Validated CRI v1 image API"
Jul 06 19:51:00.883950 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.883931    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:51:00.886274 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.886248    2581 fs.go:135] Filesystem UUIDs: map[101da477-5ca0-4edd-beb3-85f294a9a8b0:/dev/nvme0n1p4 45d28c72-e457-48be-91ba-c4ddb5568088:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 19:51:00.886376 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.886273    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:51:00.890507 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.890397    2581 manager.go:216] Machine: {Timestamp:2026-07-06 19:51:00.889871612 +0000 UTC m=+0.273530353 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104989 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2149b79a7e4ee2870cc15394ce0a37 SystemUUID:ec2149b7-9a7e-4ee2-870c-c15394ce0a37 BootID:20c915ad-9a82-46d2-b530-d19339546051 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:76:df:32:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:76:df:32:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:d4:ad:37:96:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:51:00.890507 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.890497    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:51:00.890620 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.890579    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:51:00.892238 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.892212    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:51:00.892941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.892239    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:51:00.893437 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.893416    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:51:00.893524 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.893442    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:51:00.893524 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.893454    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:51:00.894140 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.894122    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:51:00.895462 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.895446    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:51:00.895610 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.895593    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:51:00.899843 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.899829    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:51:00.899973 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.899963    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:51:00.900018 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.899995    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:51:00.900018 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.900006    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:51:00.900018 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.900016    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:51:00.900136 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.900025    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:51:00.900136 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.900034    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:51:00.900437 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.900425    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:51:00.900485 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.900444    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:51:00.902805 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.902785    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:51:00.904577 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.904563    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:51:00.904634 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.904594    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:51:00.905687 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905676    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:51:00.905728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905692    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:51:00.905728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905699    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:51:00.905728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905705    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:51:00.905728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905713    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:51:00.905728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905719    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:51:00.905728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905728    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:51:00.905964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905733    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:51:00.905964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905740    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:51:00.905964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905745    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:51:00.905964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905753    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:51:00.905964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.905759    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:51:00.906394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.906383    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:51:00.906394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.906393    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:51:00.909562 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.909547    2581 server.go:1268] "Started kubelet"
Jul 06 19:51:00.909688 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.909644    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:51:00.909745 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.909714    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:51:00.909874 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.909842    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:51:00.910524 ip-10-0-142-134 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:51:00.911486 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.911415    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:51:00.912090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.912075    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:51:00.912140 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.912108    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:51:00.912184 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.912145    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:51:00.912238 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.912075    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:51:00.915412 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.915381    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:51:00.915932 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.915192    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-134.ec2.internal.18bfcb41cb808e13  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-134.ec2.internal,UID:ip-10-0-142-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-134.ec2.internal,},FirstTimestamp:2026-07-06 19:51:00.909518355 +0000 UTC m=+0.293177095,LastTimestamp:2026-07-06 19:51:00.909518355 +0000 UTC m=+0.293177095,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-134.ec2.internal,}"
Jul 06 19:51:00.917065 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917050    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:51:00.917141 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917067    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:51:00.917380 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.917304    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:00.917646 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917626    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:51:00.917706 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917680    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:51:00.917706 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917686    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:51:00.917856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917843    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:51:00.917909 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.917858    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:51:00.918166 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918150    2581 factory.go:153] Registering CRI-O factory
Jul 06 19:51:00.918166 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918166    2581 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:51:00.918321 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918217    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:51:00.918321 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918227    2581 factory.go:55] Registering systemd factory
Jul 06 19:51:00.918321 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918235    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:51:00.918321 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918258    2581 factory.go:103] Registering Raw factory
Jul 06 19:51:00.918321 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918273    2581 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:51:00.918929 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.918909    2581 manager.go:349] Starting recovery of all containers
Jul 06 19:51:00.928905 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.928721    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:51:00.928905 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.928788    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:51:00.931751 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.931660    2581 manager.go:354] Recovery completed
Jul 06 19:51:00.935820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.935806    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:00.938288 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938263    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:00.938346 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938301    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:00.938346 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938314    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:00.938864 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938849    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:51:00.938864 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938862    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:51:00.938962 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938875    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:00.938962 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.938877    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:51:00.939618 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.939606    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:00.939671 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.939630    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:00.939671 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.939641    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:00.940731 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.940663    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-134.ec2.internal.18bfcb41cd378bfe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-134.ec2.internal,UID:ip-10-0-142-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-134.ec2.internal,},FirstTimestamp:2026-07-06 19:51:00.938288126 +0000 UTC m=+0.321946866,LastTimestamp:2026-07-06 19:51:00.938288126 +0000 UTC m=+0.321946866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-134.ec2.internal,}"
Jul 06 19:51:00.941133 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.941124    2581 policy_none.go:49] "None policy: Start"
Jul 06 19:51:00.941166 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.941138    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:51:00.941166 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.941148    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:51:00.943147 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.943136    2581 policy_none.go:47] "Start"
Jul 06 19:51:00.949613 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.949582    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8n84b"
Jul 06 19:51:00.950430 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.950339    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-134.ec2.internal.18bfcb41cd37d29f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-134.ec2.internal,UID:ip-10-0-142-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-134.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-134.ec2.internal,},FirstTimestamp:2026-07-06 19:51:00.938306207 +0000 UTC m=+0.321964948,LastTimestamp:2026-07-06 19:51:00.938306207 +0000 UTC m=+0.321964948,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-134.ec2.internal,}"
Jul 06 19:51:00.960333 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.960311    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8n84b"
Jul 06 19:51:00.960571 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.960501    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-134.ec2.internal.18bfcb41cd37ff0f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-134.ec2.internal,UID:ip-10-0-142-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-134.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-134.ec2.internal,},FirstTimestamp:2026-07-06 19:51:00.938317583 +0000 UTC m=+0.321976323,LastTimestamp:2026-07-06 19:51:00.938317583 +0000 UTC m=+0.321976323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-134.ec2.internal,}"
Jul 06 19:51:00.976032 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976014    2581 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:51:00.976181 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.976060    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:51:00.976181 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976069    2581 server.go:87] "Starting device plugin registration server"
Jul 06 19:51:00.976334 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976323    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:51:00.976389 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976335    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:51:00.976429 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976412    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:51:00.976612 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976598    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:51:00.976612 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:00.976612    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:51:00.977059 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.977040    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:51:00.977127 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:00.977098    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.015267 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.015226    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:51:01.021868 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.016629    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:51:01.021868 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.016667    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:51:01.021868 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.016690    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:51:01.021868 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.016729    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:51:01.021868 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.020825    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:51:01.076654 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.076614    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:01.078616 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.078597    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:01.078738 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.078634    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:01.078738 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.078648    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:01.078738 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.078682    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.088821 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.088799    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.088954 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.088832    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-134.ec2.internal\": node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.116452 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.116415    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.117400 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.117380    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"]
Jul 06 19:51:01.117457 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.117448    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:01.118136 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.118119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/067754c774fbc99720cce604846fd8f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal\" (UID: \"067754c774fbc99720cce604846fd8f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.118181 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.118147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/067754c774fbc99720cce604846fd8f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal\" (UID: \"067754c774fbc99720cce604846fd8f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.118438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.118422    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:01.118508 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.118452    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:01.118508 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.118480    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:01.120858 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.120843    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:01.120984 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.120968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.121037 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121006    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:01.121741 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121724    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:01.121809 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121753    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:01.121809 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121763    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:01.121809 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121726    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:01.121897 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121831    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:01.121897 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.121843    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:01.124088 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.124075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.124140 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.124100    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:01.124844 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.124829    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:01.124925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.124858    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:01.124925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.124870    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:01.148200 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.148177    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-134.ec2.internal\" not found" node="ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.153002 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.152986    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-134.ec2.internal\" not found" node="ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.216566 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.216532    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.218777 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.218757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/067754c774fbc99720cce604846fd8f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal\" (UID: \"067754c774fbc99720cce604846fd8f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.218836 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.218786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/067754c774fbc99720cce604846fd8f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal\" (UID: \"067754c774fbc99720cce604846fd8f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.218836 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.218832    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/067754c774fbc99720cce604846fd8f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal\" (UID: \"067754c774fbc99720cce604846fd8f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.218903 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.218857    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/067754c774fbc99720cce604846fd8f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal\" (UID: \"067754c774fbc99720cce604846fd8f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.316707 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.316660    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.318873 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.318848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d64b863190df7f2a681aceffe233fdc3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-134.ec2.internal\" (UID: \"d64b863190df7f2a681aceffe233fdc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.417423 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.417340    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.419560 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.419536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d64b863190df7f2a681aceffe233fdc3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-134.ec2.internal\" (UID: \"d64b863190df7f2a681aceffe233fdc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.419619 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.419577    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d64b863190df7f2a681aceffe233fdc3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-134.ec2.internal\" (UID: \"d64b863190df7f2a681aceffe233fdc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.451710 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.451682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.456005 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.455986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:01.518272 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.518231    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.618773 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.618742    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.719205 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.719139    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.819222 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.819198    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.864014 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.863984    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:51:01.864854 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.864132    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:51:01.914055 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.914019    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:51:01.919573 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:01.919539    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:01.964115 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.964062    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:46:01 +0000 UTC" deadline="2027-12-16 08:38:27.879859024 +0000 UTC"
Jul 06 19:51:01.964115 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:01.964106    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12660h47m25.915757224s"
Jul 06 19:51:02.009684 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.009607    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:51:02.011536 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.011512    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:51:02.011647 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.011550    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:51:02.011647 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.011560    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:51:02.019635 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:02.019603    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-134.ec2.internal\" not found"
Jul 06 19:51:02.029316 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.029289    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:51:02.118472 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.118439    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:02.133708 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.133677    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:51:02.134547 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.134533    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal"
Jul 06 19:51:02.143754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.143732    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:51:02.172419 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:02.172382    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64b863190df7f2a681aceffe233fdc3.slice/crio-1874e38cf4f3f48404b844399c25aacc44aaaef75facc6cd6668a4ebeaf6babd WatchSource:0}: Error finding container 1874e38cf4f3f48404b844399c25aacc44aaaef75facc6cd6668a4ebeaf6babd: Status 404 returned error can't find the container with id 1874e38cf4f3f48404b844399c25aacc44aaaef75facc6cd6668a4ebeaf6babd
Jul 06 19:51:02.172753 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:02.172729    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067754c774fbc99720cce604846fd8f3.slice/crio-3390494e772d4b1006165198ca6893e3a7734ce34bfc94943a306afcc1e86d56 WatchSource:0}: Error finding container 3390494e772d4b1006165198ca6893e3a7734ce34bfc94943a306afcc1e86d56: Status 404 returned error can't find the container with id 3390494e772d4b1006165198ca6893e3a7734ce34bfc94943a306afcc1e86d56
Jul 06 19:51:02.177860 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.177844    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:51:02.531034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.531003    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:51:02.901787 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.901697    2581 apiserver.go:52] "Watching apiserver"
Jul 06 19:51:02.908874 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.908840    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:51:02.910457 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.910019    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b8z2d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal","openshift-multus/multus-q5nmj","openshift-multus/network-metrics-daemon-gkvkc","openshift-ovn-kubernetes/ovnkube-node-9znfc","kube-system/konnectivity-agent-72x5s","kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7v2x6","openshift-dns/node-resolver-s7p65","openshift-image-registry/node-ca-sqwmf","openshift-multus/multus-additional-cni-plugins-qkjf2","openshift-network-diagnostics/network-check-target-rxg5m","openshift-network-operator/iptables-alerter-cnplx"]
Jul 06 19:51:02.913106 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.913083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:02.915242 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.915218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:02.915350 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:02.915310    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:02.916735 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.916467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-82b8z\""
Jul 06 19:51:02.916735 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.916502    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:51:02.916735 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.916506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:51:02.917336 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.917311    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:51:02.918613 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.918595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:02.920307 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.920288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.921823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.921788    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.921948 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.921826    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:51:02.922423 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.922405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-77jz6\""
Jul 06 19:51:02.922506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.922494    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.923135 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.922730    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:51:02.923135 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.922841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:02.923135 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:02.922940    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:02.923793 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.923767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.924667 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.924646    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.924768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.924731    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:51:02.924768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.924740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dcd22\""
Jul 06 19:51:02.925349 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.925328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-netns\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-cni-bin\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-kubelet\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4efc3c4-f7c4-4699-96f3-8d4f24e04f24-agent-certs\") pod \"konnectivity-agent-72x5s\" (UID: \"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24\") " pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4efc3c4-f7c4-4699-96f3-8d4f24e04f24-konnectivity-ca\") pod \"konnectivity-agent-72x5s\" (UID: \"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24\") " pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-cni-multus\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-hostroot\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-conf-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-daemon-config\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-multus-certs\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8z54\" (UniqueName: \"kubernetes.io/projected/d947ea1e-320c-47dc-ae43-9fd3534851d1-kube-api-access-c8z54\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12cd7f26-1677-4818-b69c-007b20541487-iptables-alerter-script\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-os-release\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-etc-kubernetes\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-system-cni-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-cni-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-cnibin\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.927829 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d947ea1e-320c-47dc-ae43-9fd3534851d1-cni-binary-copy\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.928264 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.927911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:02.928455 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.928419    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:51:02.928568 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.928470    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:51:02.928568 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.928481    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:51:02.928687 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.928636    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.928930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.928896    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z2q86\""
Jul 06 19:51:02.929011 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.928947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12cd7f26-1677-4818-b69c-007b20541487-host-slash\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:02.929070 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.929009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6txfl\" (UniqueName: \"kubernetes.io/projected/12cd7f26-1677-4818-b69c-007b20541487-kube-api-access-6txfl\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:02.929127 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.929072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-socket-dir-parent\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.929127 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.929106    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-k8s-cni-cncf-io\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:02.929127 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.929124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.929593 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.929295    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:51:02.930182 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.930163    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6xgz4\""
Jul 06 19:51:02.930320 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.930303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.930827 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.930803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:02.931642 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:02.931616    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:02.935540 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.932532    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.935540 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.932830    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:51:02.935540 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.934016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:02.937369 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.936856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.937369 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.937072    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:51:02.937369 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.937128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l6mvs\""
Jul 06 19:51:02.937369 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.937310    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.937998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.937976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:02.941376 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.940007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mvrlt\""
Jul 06 19:51:02.941376 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.940092    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.941376 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.940383    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.941376 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.940833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:02.943999 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.942785    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:51:02.943999 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.943072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:51:02.943999 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.943248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:02.943999 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.943283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:51:02.943999 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.943854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pfrxc\""
Jul 06 19:51:02.945378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.945338    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2js59\""
Jul 06 19:51:02.945378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.945343    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:51:02.945584 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.945528    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:51:02.958172 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.958144    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rlsjr"
Jul 06 19:51:02.966248 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:02.966223    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rlsjr"
Jul 06 19:51:03.018834 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.018796    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:51:03.023608 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.023512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal" event={"ID":"067754c774fbc99720cce604846fd8f3","Type":"ContainerStarted","Data":"3390494e772d4b1006165198ca6893e3a7734ce34bfc94943a306afcc1e86d56"}
Jul 06 19:51:03.027225 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.027196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal" event={"ID":"d64b863190df7f2a681aceffe233fdc3","Type":"ContainerStarted","Data":"1874e38cf4f3f48404b844399c25aacc44aaaef75facc6cd6668a4ebeaf6babd"}
Jul 06 19:51:03.029660 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4efc3c4-f7c4-4699-96f3-8d4f24e04f24-konnectivity-ca\") pod \"konnectivity-agent-72x5s\" (UID: \"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24\") " pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:03.029771 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-cni-multus\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.029771 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-hostroot\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.029771 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-etc-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.029771 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a016ced-71bd-43aa-bc81-5da67f10243f-ovn-node-metrics-cert\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029791    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-cni-multus\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-etc-kubernetes\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2h9k\" (UniqueName: \"kubernetes.io/projected/3d888d61-1772-4107-9062-d0fda5faf22a-kube-api-access-b2h9k\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029871    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-hostroot\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029887    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-etc-kubernetes\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-systemd-units\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.029979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.029976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-env-overrides\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-sys-fs\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-node-log\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-kubelet\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6txfl\" (UniqueName: \"kubernetes.io/projected/12cd7f26-1677-4818-b69c-007b20541487-kube-api-access-6txfl\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-socket-dir-parent\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-k8s-cni-cncf-io\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-kubelet\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-modprobe-d\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysconfig\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-conf-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.030361 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-k8s-cni-cncf-io\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-kubelet\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030430    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-conf-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-daemon-config\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-socket-dir-parent\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030501    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4efc3c4-f7c4-4699-96f3-8d4f24e04f24-konnectivity-ca\") pod \"konnectivity-agent-72x5s\" (UID: \"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24\") " pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8z54\" (UniqueName: \"kubernetes.io/projected/d947ea1e-320c-47dc-ae43-9fd3534851d1-kube-api-access-c8z54\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-host\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-os-release\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysctl-conf\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-dbus\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030917    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-os-release\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d947ea1e-320c-47dc-ae43-9fd3534851d1-cni-binary-copy\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-ovn\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.030999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-cni-bin\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031041    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-daemon-config\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-ovnkube-config\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-var-lib-kubelet\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-systemd\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47de195d-218a-4489-9e81-d587a196ae7f-hosts-file\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-system-cni-dir\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4efc3c4-f7c4-4699-96f3-8d4f24e04f24-agent-certs\") pod \"konnectivity-agent-72x5s\" (UID: \"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24\") " pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-registration-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6z2h\" (UniqueName: \"kubernetes.io/projected/49f41075-b92d-4f48-9f9c-048b13526f75-kube-api-access-n6z2h\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-log-socket\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-host\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-os-release\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-systemd\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031394    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d947ea1e-320c-47dc-ae43-9fd3534851d1-cni-binary-copy\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-kube-api-access-qf8ds\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-device-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.031958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-cnibin\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-run\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031599    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-kubelet-config\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031624    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-cnibin\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47de195d-218a-4489-9e81-d587a196ae7f-tmp-dir\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h4w2\" (UniqueName: \"kubernetes.io/projected/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-kube-api-access-2h4w2\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cni-binary-copy\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-run-netns\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-netns\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-cni-bin\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-netns\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-multus-certs\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031909    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-run-multus-certs\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-lib-modules\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031924    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-host-var-lib-cni-bin\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.032694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-tuned\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-cni-netd\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.031999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-etc-selinux\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-slash\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-var-lib-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-ovnkube-script-lib\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkw75\" (UniqueName: \"kubernetes.io/projected/47de195d-218a-4489-9e81-d587a196ae7f-kube-api-access-bkw75\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-serviceca\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cnibin\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032239    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph9jb\" (UniqueName: \"kubernetes.io/projected/19c7e58d-3e30-4a72-80fe-a83a96eaf902-kube-api-access-ph9jb\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12cd7f26-1677-4818-b69c-007b20541487-iptables-alerter-script\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysctl-d\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-system-cni-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-cni-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.033420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-kubernetes\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032597    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-system-cni-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12cd7f26-1677-4818-b69c-007b20541487-host-slash\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032678    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d947ea1e-320c-47dc-ae43-9fd3534851d1-multus-cni-dir\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-sys\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-tmp\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-socket-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032755    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12cd7f26-1677-4818-b69c-007b20541487-host-slash\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzzp4\" (UniqueName: \"kubernetes.io/projected/4a016ced-71bd-43aa-bc81-5da67f10243f-kube-api-access-hzzp4\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.033987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.032825    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12cd7f26-1677-4818-b69c-007b20541487-iptables-alerter-script\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.036499 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.036031    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4efc3c4-f7c4-4699-96f3-8d4f24e04f24-agent-certs\") pod \"konnectivity-agent-72x5s\" (UID: \"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24\") " pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:03.042283 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.042253    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6txfl\" (UniqueName: \"kubernetes.io/projected/12cd7f26-1677-4818-b69c-007b20541487-kube-api-access-6txfl\") pod \"iptables-alerter-cnplx\" (UID: \"12cd7f26-1677-4818-b69c-007b20541487\") " pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.044101 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.044075    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:03.044207 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.044105    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:03.044207 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.044120    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:03.044207 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.044185    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:03.544163376 +0000 UTC m=+2.927822119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:03.046988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.046932    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8z54\" (UniqueName: \"kubernetes.io/projected/d947ea1e-320c-47dc-ae43-9fd3534851d1-kube-api-access-c8z54\") pod \"multus-q5nmj\" (UID: \"d947ea1e-320c-47dc-ae43-9fd3534851d1\") " pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.133130 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysctl-d\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133130 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-kubernetes\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-sys\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133229    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-tmp\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-socket-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzzp4\" (UniqueName: \"kubernetes.io/projected/4a016ced-71bd-43aa-bc81-5da67f10243f-kube-api-access-hzzp4\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-etc-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133329    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysctl-d\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a016ced-71bd-43aa-bc81-5da67f10243f-ovn-node-metrics-cert\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133378 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.133406    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2h9k\" (UniqueName: \"kubernetes.io/projected/3d888d61-1772-4107-9062-d0fda5faf22a-kube-api-access-b2h9k\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.133493    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:03.633469048 +0000 UTC m=+3.017127800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-systemd-units\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-env-overrides\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-sys-fs\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-node-log\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-kubelet\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133361    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-kubernetes\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-modprobe-d\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysconfig\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-host\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.133976 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133864    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-socket-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133946    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-etc-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysctl-conf\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-dbus\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-ovn\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-cni-bin\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-ovnkube-config\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-var-lib-kubelet\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-systemd\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47de195d-218a-4489-9e81-d587a196ae7f-hosts-file\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-system-cni-dir\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-registration-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6z2h\" (UniqueName: \"kubernetes.io/projected/49f41075-b92d-4f48-9f9c-048b13526f75-kube-api-access-n6z2h\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-log-socket\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-host\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-os-release\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.134842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-systemd\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-kube-api-access-qf8ds\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-device-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-run\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-kubelet-config\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134594    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47de195d-218a-4489-9e81-d587a196ae7f-tmp-dir\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134609    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h4w2\" (UniqueName: \"kubernetes.io/projected/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-kube-api-access-2h4w2\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.133313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-sys\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cni-binary-copy\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-run-netns\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-lib-modules\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-tuned\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-cni-netd\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-etc-selinux\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.135697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-slash\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-var-lib-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134859    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-systemd-units\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-ovnkube-script-lib\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkw75\" (UniqueName: \"kubernetes.io/projected/47de195d-218a-4489-9e81-d587a196ae7f-kube-api-access-bkw75\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-serviceca\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.134979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cnibin\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph9jb\" (UniqueName: \"kubernetes.io/projected/19c7e58d-3e30-4a72-80fe-a83a96eaf902-kube-api-access-ph9jb\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135171    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysctl-conf\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.135183    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.135237    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:03.63521982 +0000 UTC m=+3.018878560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-ovnkube-script-lib\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-dbus\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135358    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-ovn\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135403    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-cni-bin\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cni-binary-copy\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.136597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135672    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-env-overrides\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135711    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-cni-netd\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135745    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-sys-fs\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135794    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-node-log\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135840    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-slash\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135859    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135881    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-run-netns\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135923    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-var-lib-openvswitch\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135962    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a016ced-71bd-43aa-bc81-5da67f10243f-ovnkube-config\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135980    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-kubelet\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136046    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-var-lib-kubelet\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-run-systemd\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136121    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-modprobe-d\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-os-release\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136172    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-host\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136189    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-systemd\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.137506 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136217    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-sysconfig\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136268    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-registration-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136308    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136354    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47de195d-218a-4489-9e81-d587a196ae7f-hosts-file\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136173    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-system-cni-dir\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136373    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-device-dir\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-run\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136469    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-lib-modules\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136488    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a016ced-71bd-43aa-bc81-5da67f10243f-log-socket\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136500    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-kubelet-config\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136129    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-host\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136540    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19c7e58d-3e30-4a72-80fe-a83a96eaf902-cnibin\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.135788    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49f41075-b92d-4f48-9f9c-048b13526f75-etc-selinux\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136791    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47de195d-218a-4489-9e81-d587a196ae7f-tmp-dir\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.136856    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-tmp\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.138525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.137144    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a016ced-71bd-43aa-bc81-5da67f10243f-ovn-node-metrics-cert\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.139279 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.138969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-etc-tuned\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.139680 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.139655    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-serviceca\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.148668 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.148626    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h4w2\" (UniqueName: \"kubernetes.io/projected/3f7ce1ef-fedf-498b-87fe-9b898c13fb77-kube-api-access-2h4w2\") pod \"node-ca-sqwmf\" (UID: \"3f7ce1ef-fedf-498b-87fe-9b898c13fb77\") " pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.149056 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.148741    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2h9k\" (UniqueName: \"kubernetes.io/projected/3d888d61-1772-4107-9062-d0fda5faf22a-kube-api-access-b2h9k\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:03.149056 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.148931    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzzp4\" (UniqueName: \"kubernetes.io/projected/4a016ced-71bd-43aa-bc81-5da67f10243f-kube-api-access-hzzp4\") pod \"ovnkube-node-9znfc\" (UID: \"4a016ced-71bd-43aa-bc81-5da67f10243f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.151632 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.151581    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8ds\" (UniqueName: \"kubernetes.io/projected/df36f6ea-4516-4c5f-ab5d-5f9f9383e042-kube-api-access-qf8ds\") pod \"tuned-7v2x6\" (UID: \"df36f6ea-4516-4c5f-ab5d-5f9f9383e042\") " pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.151745 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.151709    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph9jb\" (UniqueName: \"kubernetes.io/projected/19c7e58d-3e30-4a72-80fe-a83a96eaf902-kube-api-access-ph9jb\") pod \"multus-additional-cni-plugins-qkjf2\" (UID: \"19c7e58d-3e30-4a72-80fe-a83a96eaf902\") " pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.152303 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.152255    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6z2h\" (UniqueName: \"kubernetes.io/projected/49f41075-b92d-4f48-9f9c-048b13526f75-kube-api-access-n6z2h\") pod \"aws-ebs-csi-driver-node-mctx5\" (UID: \"49f41075-b92d-4f48-9f9c-048b13526f75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.152704 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.152682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkw75\" (UniqueName: \"kubernetes.io/projected/47de195d-218a-4489-9e81-d587a196ae7f-kube-api-access-bkw75\") pod \"node-resolver-s7p65\" (UID: \"47de195d-218a-4489-9e81-d587a196ae7f\") " pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.227403 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.227348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:03.237126 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.237094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnplx"
Jul 06 19:51:03.246612 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.246577    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5nmj"
Jul 06 19:51:03.253608 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.253586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:03.264558 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.264529    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7v2x6"
Jul 06 19:51:03.272811 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.272779    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5"
Jul 06 19:51:03.283681 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.283654    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s7p65"
Jul 06 19:51:03.291643 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.291617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sqwmf"
Jul 06 19:51:03.299618 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.299596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qkjf2"
Jul 06 19:51:03.316046 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.316014    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:51:03.640787 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.640752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:03.640787 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.640798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.640838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.640955    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.640988    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.641006    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.641009    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.641018    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.641042    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:04.641010456 +0000 UTC m=+4.024669190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.641073    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:04.641057805 +0000 UTC m=+4.024716548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:03.641125 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:03.641100    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:04.641087632 +0000 UTC m=+4.024746371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:03.970148 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.970107    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:46:03 +0000 UTC" deadline="2028-01-09 12:03:26.491650696 +0000 UTC"
Jul 06 19:51:03.970148 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:03.970142    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13240h12m22.521513001s"
Jul 06 19:51:04.376432 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.376155    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a016ced_71bd_43aa_bc81_5da67f10243f.slice/crio-de99a5311b5931a701081c016b715059af962c2a3fd8d13468d91dd187d08557 WatchSource:0}: Error finding container de99a5311b5931a701081c016b715059af962c2a3fd8d13468d91dd187d08557: Status 404 returned error can't find the container with id de99a5311b5931a701081c016b715059af962c2a3fd8d13468d91dd187d08557
Jul 06 19:51:04.378078 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.378052    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c7e58d_3e30_4a72_80fe_a83a96eaf902.slice/crio-ba7dc82ace205e334ebc4dde15f9dd37b25388446aea55572147df20cbff39c3 WatchSource:0}: Error finding container ba7dc82ace205e334ebc4dde15f9dd37b25388446aea55572147df20cbff39c3: Status 404 returned error can't find the container with id ba7dc82ace205e334ebc4dde15f9dd37b25388446aea55572147df20cbff39c3
Jul 06 19:51:04.379969 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.379939    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7ce1ef_fedf_498b_87fe_9b898c13fb77.slice/crio-6e6e8a824792d9edbb8fcb518a0c34ab97fd0e0cce37ff3974033ab90403831f WatchSource:0}: Error finding container 6e6e8a824792d9edbb8fcb518a0c34ab97fd0e0cce37ff3974033ab90403831f: Status 404 returned error can't find the container with id 6e6e8a824792d9edbb8fcb518a0c34ab97fd0e0cce37ff3974033ab90403831f
Jul 06 19:51:04.381730 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.381276    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f41075_b92d_4f48_9f9c_048b13526f75.slice/crio-64474e01d2b8ceaf1100c96ad66912f0f25d8a4bc5a24e0e06a3e7300479022b WatchSource:0}: Error finding container 64474e01d2b8ceaf1100c96ad66912f0f25d8a4bc5a24e0e06a3e7300479022b: Status 404 returned error can't find the container with id 64474e01d2b8ceaf1100c96ad66912f0f25d8a4bc5a24e0e06a3e7300479022b
Jul 06 19:51:04.384798 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.384769    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf36f6ea_4516_4c5f_ab5d_5f9f9383e042.slice/crio-a72c27934e564095632a3c3794dca0d6b0a18416a6f85473c4d28576c4094381 WatchSource:0}: Error finding container a72c27934e564095632a3c3794dca0d6b0a18416a6f85473c4d28576c4094381: Status 404 returned error can't find the container with id a72c27934e564095632a3c3794dca0d6b0a18416a6f85473c4d28576c4094381
Jul 06 19:51:04.386877 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.386854    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cd7f26_1677_4818_b69c_007b20541487.slice/crio-444791ea6e8cfab8d03c6ff3c23988622472fc4c721f2ada38f9852e276e66a0 WatchSource:0}: Error finding container 444791ea6e8cfab8d03c6ff3c23988622472fc4c721f2ada38f9852e276e66a0: Status 404 returned error can't find the container with id 444791ea6e8cfab8d03c6ff3c23988622472fc4c721f2ada38f9852e276e66a0
Jul 06 19:51:04.387175 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.387151    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4efc3c4_f7c4_4699_96f3_8d4f24e04f24.slice/crio-21c0d0791b79cf732842709adae7df597a6341caf56ed514cfd9ed8bd54334ce WatchSource:0}: Error finding container 21c0d0791b79cf732842709adae7df597a6341caf56ed514cfd9ed8bd54334ce: Status 404 returned error can't find the container with id 21c0d0791b79cf732842709adae7df597a6341caf56ed514cfd9ed8bd54334ce
Jul 06 19:51:04.389516 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:04.389387    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd947ea1e_320c_47dc_ae43_9fd3534851d1.slice/crio-087599552ad559b2df6e6ff89b0b61c572fdbd9ffda59106dc2cc9999385c97f WatchSource:0}: Error finding container 087599552ad559b2df6e6ff89b0b61c572fdbd9ffda59106dc2cc9999385c97f: Status 404 returned error can't find the container with id 087599552ad559b2df6e6ff89b0b61c572fdbd9ffda59106dc2cc9999385c97f
Jul 06 19:51:04.649349 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:04.649318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:04.649472 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:04.649363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:04.649472 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:04.649424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:04.649548 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649523    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:04.649583 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:06.649561513 +0000 UTC m=+6.033220242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:04.649890 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649876    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:04.649923 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649916    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:06.649905957 +0000 UTC m=+6.033564687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:04.649981 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649970    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:04.650014 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649985    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:04.650014 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.649995    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:04.650077 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:04.650019    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:06.650012314 +0000 UTC m=+6.033671043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:04.971297 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:04.971132    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:46:03 +0000 UTC" deadline="2028-01-22 15:19:14.079478175 +0000 UTC"
Jul 06 19:51:04.971297 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:04.971199    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13555h28m9.108284088s"
Jul 06 19:51:05.019065 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.017969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:05.019065 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:05.018112    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:05.019065 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.018724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:05.019065 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:05.018838    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:05.019065 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.018949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:05.019065 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:05.019029    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:05.037712 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.036901    2581 generic.go:356] "Generic (PLEG): container finished" podID="067754c774fbc99720cce604846fd8f3" containerID="9275a3c5d025c26b4107662e762abcc5a09ad56a8af79fbdb5430c6a31333cdc" exitCode=0
Jul 06 19:51:05.037907 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.037787    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal" event={"ID":"067754c774fbc99720cce604846fd8f3","Type":"ContainerDied","Data":"9275a3c5d025c26b4107662e762abcc5a09ad56a8af79fbdb5430c6a31333cdc"}
Jul 06 19:51:05.043704 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.043632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s7p65" event={"ID":"47de195d-218a-4489-9e81-d587a196ae7f","Type":"ContainerStarted","Data":"a64256dd9f5b351f6df7de5a7fdbe46c9cf3a54bf8b58213e31e522c3f3f07e6"}
Jul 06 19:51:05.048880 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.048811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7v2x6" event={"ID":"df36f6ea-4516-4c5f-ab5d-5f9f9383e042","Type":"ContainerStarted","Data":"a72c27934e564095632a3c3794dca0d6b0a18416a6f85473c4d28576c4094381"}
Jul 06 19:51:05.056840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.056809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5" event={"ID":"49f41075-b92d-4f48-9f9c-048b13526f75","Type":"ContainerStarted","Data":"64474e01d2b8ceaf1100c96ad66912f0f25d8a4bc5a24e0e06a3e7300479022b"}
Jul 06 19:51:05.066310 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.066272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sqwmf" event={"ID":"3f7ce1ef-fedf-498b-87fe-9b898c13fb77","Type":"ContainerStarted","Data":"6e6e8a824792d9edbb8fcb518a0c34ab97fd0e0cce37ff3974033ab90403831f"}
Jul 06 19:51:05.074330 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.074204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"de99a5311b5931a701081c016b715059af962c2a3fd8d13468d91dd187d08557"}
Jul 06 19:51:05.079108 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.079074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal" event={"ID":"d64b863190df7f2a681aceffe233fdc3","Type":"ContainerStarted","Data":"c1956c045817ecf24b91b15dfc4697bf5cfcbe298144250a2ac625a1da607720"}
Jul 06 19:51:05.084163 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.084124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5nmj" event={"ID":"d947ea1e-320c-47dc-ae43-9fd3534851d1","Type":"ContainerStarted","Data":"087599552ad559b2df6e6ff89b0b61c572fdbd9ffda59106dc2cc9999385c97f"}
Jul 06 19:51:05.090735 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.090701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-72x5s" event={"ID":"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24","Type":"ContainerStarted","Data":"21c0d0791b79cf732842709adae7df597a6341caf56ed514cfd9ed8bd54334ce"}
Jul 06 19:51:05.093237 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.093203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnplx" event={"ID":"12cd7f26-1677-4818-b69c-007b20541487","Type":"ContainerStarted","Data":"444791ea6e8cfab8d03c6ff3c23988622472fc4c721f2ada38f9852e276e66a0"}
Jul 06 19:51:05.102970 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:05.102899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerStarted","Data":"ba7dc82ace205e334ebc4dde15f9dd37b25388446aea55572147df20cbff39c3"}
Jul 06 19:51:06.128479 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:06.128227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal" event={"ID":"067754c774fbc99720cce604846fd8f3","Type":"ContainerStarted","Data":"6359fcc07d56ce06753e82791388ebf322e9d7e8f7543703e4b71993ed9a1af7"}
Jul 06 19:51:06.147385 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:06.146249    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-134.ec2.internal" podStartSLOduration=3.146225275 podStartE2EDuration="3.146225275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:05.097276121 +0000 UTC m=+4.480934874" watchObservedRunningTime="2026-07-06 19:51:06.146225275 +0000 UTC m=+5.529884034"
Jul 06 19:51:06.147385 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:06.147064    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-134.ec2.internal" podStartSLOduration=3.147046421 podStartE2EDuration="3.147046421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:06.146036495 +0000 UTC m=+5.529695240" watchObservedRunningTime="2026-07-06 19:51:06.147046421 +0000 UTC m=+5.530705181"
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:06.666166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:06.666224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:06.666263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.666468    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.666493    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.666508    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.666575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:10.666555862 +0000 UTC m=+10.050214605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.667003    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.667069    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:10.667049719 +0000 UTC m=+10.050708477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.667144    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:06.667247 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:06.667180    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:10.667168435 +0000 UTC m=+10.050827178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:07.017587 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:07.017493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:07.017753 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:07.017623    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:07.018054 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:07.018031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:07.018172 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:07.018148    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:07.020753 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:07.020730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:07.020883 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:07.020838    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:09.017427 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:09.017287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:09.017927 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:09.017469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:09.017927 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:09.017573    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:09.018140 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:09.018074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:09.018140 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:09.018101    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:09.018263 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:09.018171    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:10.702353 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:10.702316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:10.702353 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:10.702357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:10.702420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702527    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702549    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702558    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702610    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702623    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702625    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:18.702601323 +0000 UTC m=+18.086260051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702677    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:18.702663861 +0000 UTC m=+18.086322590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:10.702871 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:10.702687    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:18.702681018 +0000 UTC m=+18.086339747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:11.018422 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:11.018325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:11.018556 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:11.018483    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:11.018556 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:11.018505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:11.018556 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:11.018499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:11.018664 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:11.018589    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:11.018732 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:11.018703    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:13.017597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:13.017556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:13.018050 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:13.017556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:13.018050 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:13.017706    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:13.018050 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:13.017560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:13.018050 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:13.017805    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:13.018050 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:13.017870    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:15.017947 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:15.017791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:15.017947 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:15.017829    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:15.017947 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:15.017797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:15.017947 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:15.017905    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:15.018503 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:15.018026    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:15.018503 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:15.018113    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:16.156349 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.156138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s7p65" event={"ID":"47de195d-218a-4489-9e81-d587a196ae7f","Type":"ContainerStarted","Data":"7dde4ae932d99bd44d17ee23c1289bb22c2009603bc84b4036bc94a9f44859c7"}
Jul 06 19:51:16.158152 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.158124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7v2x6" event={"ID":"df36f6ea-4516-4c5f-ab5d-5f9f9383e042","Type":"ContainerStarted","Data":"5f8248585a232d236e6c65a91baa347ada93c24f283bb337c1dff5c280bd67c2"}
Jul 06 19:51:16.159707 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.159685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5" event={"ID":"49f41075-b92d-4f48-9f9c-048b13526f75","Type":"ContainerStarted","Data":"7cb60152a2d03f3e008397d81f47b849a12d2a34595c6f159e0a9664b5e6a5bb"}
Jul 06 19:51:16.161516 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.161168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sqwmf" event={"ID":"3f7ce1ef-fedf-498b-87fe-9b898c13fb77","Type":"ContainerStarted","Data":"b2586a0e4a91af95871f58e05866d950cdd7d50c5c0a0293887fd25cad377523"}
Jul 06 19:51:16.162654 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.162633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-72x5s" event={"ID":"e4efc3c4-f7c4-4699-96f3-8d4f24e04f24","Type":"ContainerStarted","Data":"66c0891b44c01cc1154b97e1dfd0d700495443302ec60fcbd0e3f75d3d89fcb0"}
Jul 06 19:51:16.164207 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.164185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerStarted","Data":"0076bdee9af0e86314d26721b731db5fcafa74d6b7191e79ca50e67a38464df3"}
Jul 06 19:51:16.173768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.173715    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s7p65" podStartSLOduration=3.001450296 podStartE2EDuration="14.173697031s" totalImagesPullingTime="11.172246735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:16.173563341 +0000 UTC m=+15.557222090" watchObservedRunningTime="2026-07-06 19:51:16.173697031 +0000 UTC m=+15.557355781"
Jul 06 19:51:16.215769 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.215710    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7v2x6" podStartSLOduration=3.010833235 podStartE2EDuration="14.215688513s" totalImagesPullingTime="11.204855278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:16.198186234 +0000 UTC m=+15.581844984" watchObservedRunningTime="2026-07-06 19:51:16.215688513 +0000 UTC m=+15.599347263"
Jul 06 19:51:16.216016 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:16.215977    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sqwmf" podStartSLOduration=3.039104572 podStartE2EDuration="14.215965671s" totalImagesPullingTime="11.176861099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:16.215822487 +0000 UTC m=+15.599481221" watchObservedRunningTime="2026-07-06 19:51:16.215965671 +0000 UTC m=+15.599624419"
Jul 06 19:51:17.017907 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:17.017873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:17.018077 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:17.017873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:17.018077 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:17.018007    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:17.018077 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:17.018007    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:17.018192 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:17.018083    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:17.018192 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:17.018153    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:17.168172 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:17.168134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnplx" event={"ID":"12cd7f26-1677-4818-b69c-007b20541487","Type":"ContainerStarted","Data":"97614ee12bbedbdd2fdca360568feeef62d6cce599f6a452d64d8829dd06821b"}
Jul 06 19:51:17.213013 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:17.212956    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-72x5s" podStartSLOduration=4.082890182 podStartE2EDuration="15.212940993s" totalImagesPullingTime="11.130050811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:16.349534307 +0000 UTC m=+15.733193057" watchObservedRunningTime="2026-07-06 19:51:17.212940993 +0000 UTC m=+16.596599755"
Jul 06 19:51:17.213329 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:17.213299    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cnplx" podStartSLOduration=4.042740016 podStartE2EDuration="15.213287227s" totalImagesPullingTime="11.170547211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:17.212801745 +0000 UTC m=+16.596460495" watchObservedRunningTime="2026-07-06 19:51:17.213287227 +0000 UTC m=+16.596945976"
Jul 06 19:51:18.674513 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:18.674480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:18.675087 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:18.675073    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:18.770063 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:18.770024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:18.770277 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770156    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:18.770277 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:34.770193472 +0000 UTC m=+34.153852199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:18.770425 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:18.770355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:18.770491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:18.770440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:18.770562 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770545    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:18.770624 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770571    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:18.770624 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770582    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:18.770624 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770604    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:18.770769 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770633    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:34.770616806 +0000 UTC m=+34.154275534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:18.770769 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:18.770651    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:34.770642703 +0000 UTC m=+34.154301435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:19.017286 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:19.017200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:19.017286 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:19.017200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:19.017526 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:19.017342    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:19.017526 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:19.017200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:19.017526 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:19.017433    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:19.017526 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:19.017485    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:19.173910 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:19.173879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:19.174504 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:19.174482    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-72x5s"
Jul 06 19:51:20.177394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:20.177167    2581 generic.go:356] "Generic (PLEG): container finished" podID="19c7e58d-3e30-4a72-80fe-a83a96eaf902" containerID="0076bdee9af0e86314d26721b731db5fcafa74d6b7191e79ca50e67a38464df3" exitCode=0
Jul 06 19:51:20.177394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:20.177237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerDied","Data":"0076bdee9af0e86314d26721b731db5fcafa74d6b7191e79ca50e67a38464df3"}
Jul 06 19:51:21.018681 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:21.018423    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:21.018849 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:21.018485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:21.018849 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:21.018776    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:21.018949 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:21.018878    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:21.018949 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:21.018525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:21.019052 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:21.018978    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:23.020754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:23.020721    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:23.021311 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:23.020763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:23.021311 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:23.020762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:23.021311 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:23.020852    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:23.021311 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:23.020926    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:23.021311 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:23.020986    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:25.019050 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.018193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:25.019050 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:25.018579    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:25.019050 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.018316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:25.019050 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:25.018675    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:25.019050 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.018193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:25.019050 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:25.018739    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:25.096352 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.096324    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:51:25.189760 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.189717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5" event={"ID":"49f41075-b92d-4f48-9f9c-048b13526f75","Type":"ContainerStarted","Data":"3a086fc39fef4103311f2c077394a5da466a31e1dc5f111e054fa3a4b2cc0377"}
Jul 06 19:51:25.192211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.192161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"f7fce621cc9f11e19db07908e81b2601829e9f0ee03b573d97176e01de912d50"}
Jul 06 19:51:25.192317 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.192239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"a8cbf195f8b8101a6b6c2d041dcf936d88e890e83d384f655e0c472aaf6eddec"}
Jul 06 19:51:25.192317 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.192289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"c6318063b2c12ce67a07bd06b8956ee276282d9adea0c4bf792746fda0e5691b"}
Jul 06 19:51:25.192517 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.192334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"97c7e96753bd3bf98c9d18042a0b58f6f2329056748b8c2051fb4d6bb571413a"}
Jul 06 19:51:25.193790 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.193767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5nmj" event={"ID":"d947ea1e-320c-47dc-ae43-9fd3534851d1","Type":"ContainerStarted","Data":"4f9f6860f2f1e8efaa3a02d883a26a9ea14f0add6403796e073082ee2973737d"}
Jul 06 19:51:25.217594 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.217533    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q5nmj" podStartSLOduration=2.9571105810000002 podStartE2EDuration="23.217517768s" totalImagesPullingTime="20.260407187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:25.217001946 +0000 UTC m=+24.600660695" watchObservedRunningTime="2026-07-06 19:51:25.217517768 +0000 UTC m=+24.601176517"
Jul 06 19:51:25.991723 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.991622    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:51:25.096345458Z","UUID":"b4c795f3-cdc9-4cfa-9a7e-d4f54e4bc9f0","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:51:25.993057 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.993039    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:51:25.993162 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:25.993081    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:51:26.198732 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:26.198700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"2bff929e30639d8e49f9b7f2a6ebfdaa56e962f8448f2cc71156af1011675867"}
Jul 06 19:51:26.199203 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:26.198770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"8f58f9e275f356a1bc1e5f423fc01c42cf6a84ebf6670cc6876078f353a641ab"}
Jul 06 19:51:27.017185 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:27.017149    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:27.017386 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:27.017149    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:27.017386 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:27.017287    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:27.017386 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:27.017161    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:27.017386 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:27.017333    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:27.017539 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:27.017446    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:27.203057 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:27.203021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5" event={"ID":"49f41075-b92d-4f48-9f9c-048b13526f75","Type":"ContainerStarted","Data":"f42aa92d13eba6de0062f420ff562109f59eb05535e23725c6e01f297205b282"}
Jul 06 19:51:27.239931 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:27.239881    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mctx5" podStartSLOduration=3.818695673 podStartE2EDuration="25.23986554s" totalImagesPullingTime="21.421169867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:27.239527515 +0000 UTC m=+26.623186265" watchObservedRunningTime="2026-07-06 19:51:27.23986554 +0000 UTC m=+26.623524516"
Jul 06 19:51:28.208457 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:28.208420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"6a3bf7e5548e60ad1307f211b7f2fb3cfa6a83e59425d9d5c99779426a8e4d03"}
Jul 06 19:51:29.017337 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:29.017301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:29.017337 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:29.017324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:29.017586 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:29.017301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:29.017586 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:29.017436    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:29.017586 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:29.017552    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:29.017729 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:29.017663    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:31.017701 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.017504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:31.018293 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.017607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:31.018293 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:31.017774    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:31.018293 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:31.017839    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:31.018293 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.017640    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:31.018293 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:31.017942    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:31.217912 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.217877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" event={"ID":"4a016ced-71bd-43aa-bc81-5da67f10243f","Type":"ContainerStarted","Data":"3534698b5495a14e5340a71f71492153e10000ac04b77beec1d3637367f2f6bb"}
Jul 06 19:51:31.218150 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.218131    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:31.219818 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.219789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerStarted","Data":"cb6b98d683c59d5f256297f0cad5246bf0793d70097d1404cf592eb5a0074b2e"}
Jul 06 19:51:31.234730 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.234694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:31.249096 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:31.249049    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc" podStartSLOduration=8.922940047 podStartE2EDuration="29.249033658s" totalImagesPullingTime="20.326093611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:31.248514506 +0000 UTC m=+30.632173257" watchObservedRunningTime="2026-07-06 19:51:31.249033658 +0000 UTC m=+30.632692406"
Jul 06 19:51:32.224111 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.224074    2581 generic.go:356] "Generic (PLEG): container finished" podID="19c7e58d-3e30-4a72-80fe-a83a96eaf902" containerID="cb6b98d683c59d5f256297f0cad5246bf0793d70097d1404cf592eb5a0074b2e" exitCode=0
Jul 06 19:51:32.224526 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.224153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerDied","Data":"cb6b98d683c59d5f256297f0cad5246bf0793d70097d1404cf592eb5a0074b2e"}
Jul 06 19:51:32.224583 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.224545    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:32.224627 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.224621    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:32.240826 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.240797    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:51:32.961227 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.961192    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8z2d"]
Jul 06 19:51:32.961442 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.961314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:32.961442 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:32.961420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:32.965099 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.964863    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxg5m"]
Jul 06 19:51:32.965099 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.964982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:32.965099 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:32.965060    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:32.965502 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.965483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkvkc"]
Jul 06 19:51:32.965605 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:32.965591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:32.965714 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:32.965692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:34.234485 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:34.234454    2581 generic.go:356] "Generic (PLEG): container finished" podID="19c7e58d-3e30-4a72-80fe-a83a96eaf902" containerID="b90a88262a43b83d4bb908b3af9356e559dd2aa81c1ef50c7af95b32ff61b2ca" exitCode=0
Jul 06 19:51:34.234846 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:34.234535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerDied","Data":"b90a88262a43b83d4bb908b3af9356e559dd2aa81c1ef50c7af95b32ff61b2ca"}
Jul 06 19:51:34.785775 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:34.785586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:34.785786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:34.785811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785737    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785901    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs podName:3d888d61-1772-4107-9062-d0fda5faf22a nodeName:}" failed. No retries permitted until 2026-07-06 19:52:06.785881088 +0000 UTC m=+66.169539815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs") pod "network-metrics-daemon-gkvkc" (UID: "3d888d61-1772-4107-9062-d0fda5faf22a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785910    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785930    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785941    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785960    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6cl7r for pod openshift-network-diagnostics/network-check-target-rxg5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785978    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret podName:1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:06.785965497 +0000 UTC m=+66.169624226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret") pod "global-pull-secret-syncer-b8z2d" (UID: "1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:51:34.786039 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:34.785997    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r podName:70c9ec68-2078-4ec5-903b-8656846e34d4 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:06.785988622 +0000 UTC m=+66.169647349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cl7r" (UniqueName: "kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r") pod "network-check-target-rxg5m" (UID: "70c9ec68-2078-4ec5-903b-8656846e34d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:51:35.017741 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:35.017705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:35.017925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:35.017705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:35.017925 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:35.017817    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:35.017925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:35.017712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:35.017925 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:35.017877    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:35.018266 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:35.017954    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:35.239451 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:35.239419    2581 generic.go:356] "Generic (PLEG): container finished" podID="19c7e58d-3e30-4a72-80fe-a83a96eaf902" containerID="826f5c850130b8ae2a36ce14e6b7dc44ef38100bc3c86ab1b22a4e421e18e17c" exitCode=0
Jul 06 19:51:35.239820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:35.239463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerDied","Data":"826f5c850130b8ae2a36ce14e6b7dc44ef38100bc3c86ab1b22a4e421e18e17c"}
Jul 06 19:51:37.017177 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:37.017137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:37.017728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:37.017137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:37.017728 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:37.017272    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxg5m" podUID="70c9ec68-2078-4ec5-903b-8656846e34d4"
Jul 06 19:51:37.017728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:37.017140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:37.017728 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:37.017358    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8z2d" podUID="1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3"
Jul 06 19:51:37.017728 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:37.017445    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkvkc" podUID="3d888d61-1772-4107-9062-d0fda5faf22a"
Jul 06 19:51:38.507307 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.507227    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-134.ec2.internal" event="NodeReady"
Jul 06 19:51:38.507767 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.507389    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:51:38.549204 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.549167    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b44b8988c-qzbzz"]
Jul 06 19:51:38.574810 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.574783    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-29kdl"]
Jul 06 19:51:38.574963 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.574915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.576865 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.576842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:51:38.576979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.576848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:51:38.576979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.576875    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29xts\""
Jul 06 19:51:38.577199 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.577184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:51:38.583536 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.583515    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:51:38.598870 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.598836    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b44b8988c-qzbzz"]
Jul 06 19:51:38.599031 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.598883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29kdl"]
Jul 06 19:51:38.599031 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.598968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.601327 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.601299    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:51:38.601327 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.601322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:51:38.601538 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.601322    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:51:38.601538 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.601299    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vp5kp\""
Jul 06 19:51:38.671044 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.671011    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zrbbp"]
Jul 06 19:51:38.691294 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.691259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zrbbp"]
Jul 06 19:51:38.691485 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.691419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.693786 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.693764    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wzh6g\""
Jul 06 19:51:38.695767 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.695745    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:51:38.695767 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.695764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:51:38.715314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7660ad3-3a21-4481-be80-f3101f61c134-ca-trust-extracted\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-trusted-ca\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715592 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-image-registry-private-configuration\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715592 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf695\" (UniqueName: \"kubernetes.io/projected/341589de-3337-415a-a791-37875cd49f36-kube-api-access-jf695\") pod \"ingress-canary-29kdl\" (UID: \"341589de-3337-415a-a791-37875cd49f36\") " pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.715592 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715592 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-installation-pull-secrets\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715750 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/341589de-3337-415a-a791-37875cd49f36-cert\") pod \"ingress-canary-29kdl\" (UID: \"341589de-3337-415a-a791-37875cd49f36\") " pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.715750 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-bound-sa-token\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715750 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h698f\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-kube-api-access-h698f\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.715858 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.715761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-registry-certificates\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.816922 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.816883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-registry-certificates\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.816939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7660ad3-3a21-4481-be80-f3101f61c134-ca-trust-extracted\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.816967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-trusted-ca\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.816991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhx5j\" (UniqueName: \"kubernetes.io/projected/6f354a22-d010-4046-ad58-42edce5e8032-kube-api-access-hhx5j\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-image-registry-private-configuration\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf695\" (UniqueName: \"kubernetes.io/projected/341589de-3337-415a-a791-37875cd49f36-kube-api-access-jf695\") pod \"ingress-canary-29kdl\" (UID: \"341589de-3337-415a-a791-37875cd49f36\") " pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.817095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-installation-pull-secrets\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/341589de-3337-415a-a791-37875cd49f36-cert\") pod \"ingress-canary-29kdl\" (UID: \"341589de-3337-415a-a791-37875cd49f36\") " pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.817332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f354a22-d010-4046-ad58-42edce5e8032-config-volume\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.817332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-bound-sa-token\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h698f\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-kube-api-access-h698f\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f354a22-d010-4046-ad58-42edce5e8032-tmp-dir\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.817569 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817540    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7660ad3-3a21-4481-be80-f3101f61c134-ca-trust-extracted\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.817627    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-registry-certificates\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.817774 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:38.817743    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:51:38.817774 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:38.817765    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b44b8988c-qzbzz: secret "image-registry-tls" not found
Jul 06 19:51:38.818021 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:38.817822    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls podName:e7660ad3-3a21-4481-be80-f3101f61c134 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:39.317803509 +0000 UTC m=+38.701462241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls") pod "image-registry-7b44b8988c-qzbzz" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134") : secret "image-registry-tls" not found
Jul 06 19:51:38.818398 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.818356    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-trusted-ca\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.822469 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.822434    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-installation-pull-secrets\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.822469 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.822445    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/341589de-3337-415a-a791-37875cd49f36-cert\") pod \"ingress-canary-29kdl\" (UID: \"341589de-3337-415a-a791-37875cd49f36\") " pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.822469 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.822453    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-image-registry-private-configuration\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.828987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.827201    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf695\" (UniqueName: \"kubernetes.io/projected/341589de-3337-415a-a791-37875cd49f36-kube-api-access-jf695\") pod \"ingress-canary-29kdl\" (UID: \"341589de-3337-415a-a791-37875cd49f36\") " pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.828987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.827950    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h698f\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-kube-api-access-h698f\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.830766 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.830744    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-bound-sa-token\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:38.910156 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.910120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29kdl"
Jul 06 19:51:38.918546 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.918511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f354a22-d010-4046-ad58-42edce5e8032-config-volume\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.918546 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.918547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f354a22-d010-4046-ad58-42edce5e8032-tmp-dir\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.918739 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.918585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.918739 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.918602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhx5j\" (UniqueName: \"kubernetes.io/projected/6f354a22-d010-4046-ad58-42edce5e8032-kube-api-access-hhx5j\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.918739 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:38.918714    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:38.918888 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:38.918804    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls podName:6f354a22-d010-4046-ad58-42edce5e8032 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:39.418788149 +0000 UTC m=+38.802446879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls") pod "dns-default-zrbbp" (UID: "6f354a22-d010-4046-ad58-42edce5e8032") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:38.918888 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.918859    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f354a22-d010-4046-ad58-42edce5e8032-tmp-dir\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.919184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.919161    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f354a22-d010-4046-ad58-42edce5e8032-config-volume\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:38.929830 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:38.929810    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhx5j\" (UniqueName: \"kubernetes.io/projected/6f354a22-d010-4046-ad58-42edce5e8032-kube-api-access-hhx5j\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:39.017572 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.017534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:51:39.017743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.017542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:51:39.017743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.017542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:51:39.019839 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.019817    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:51:39.019839 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.019835    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:51:39.020314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.020293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:51:39.020424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.020338    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hp2zw\""
Jul 06 19:51:39.020719 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.020594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:51:39.020719 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.020700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c45tr\""
Jul 06 19:51:39.285494 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.285343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:39.321598 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.321561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:39.321797 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:39.321731    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:51:39.321797 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:39.321754    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b44b8988c-qzbzz: secret "image-registry-tls" not found
Jul 06 19:51:39.321912 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:39.321812    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls podName:e7660ad3-3a21-4481-be80-f3101f61c134 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:40.321795939 +0000 UTC m=+39.705454684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls") pod "image-registry-7b44b8988c-qzbzz" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134") : secret "image-registry-tls" not found
Jul 06 19:51:39.394026 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.393981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:39.421974 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:39.421928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:39.422156 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:39.422073    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:39.422156 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:39.422155    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls podName:6f354a22-d010-4046-ad58-42edce5e8032 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:40.422139541 +0000 UTC m=+39.805798272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls") pod "dns-default-zrbbp" (UID: "6f354a22-d010-4046-ad58-42edce5e8032") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:40.161912 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.161875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:40.192943 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.192904    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"]
Jul 06 19:51:40.218224 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.218186    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"]
Jul 06 19:51:40.218410 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.218281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.227431 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.227399    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rnc6k\""
Jul 06 19:51:40.227695 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.227662    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 19:51:40.227892 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.227873    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.227974 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.227942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 19:51:40.228078 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.228063    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.232279 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.232256    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"]
Jul 06 19:51:40.232424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.232399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"
Jul 06 19:51:40.234355 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.234337    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8hxqx\""
Jul 06 19:51:40.253112 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.253085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d5fdddbfc-xwvqf"]
Jul 06 19:51:40.253387 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.253338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.255989 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.255883    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 19:51:40.256804 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.256782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fsjmz\""
Jul 06 19:51:40.256900 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.256850    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 19:51:40.257129 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.257107    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.258419 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.258399    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.278762 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.278731    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-r5dtb"]
Jul 06 19:51:40.278917 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.278880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.281417 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.281391    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 19:51:40.281550 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.281532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 19:51:40.281722 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.281702    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.281796 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.281755    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vpntw\""
Jul 06 19:51:40.282121 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.281975    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 19:51:40.282121 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.281976    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.287750 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.287354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 19:51:40.291816 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.291793    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"]
Jul 06 19:51:40.291921 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.291834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"]
Jul 06 19:51:40.291921 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.291858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"]
Jul 06 19:51:40.291921 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.291877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-r5dtb"]
Jul 06 19:51:40.291921 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.291896    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"]
Jul 06 19:51:40.292131 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.291924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.297992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.297970    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 19:51:40.298188 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.298175    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.298408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.298353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.298533 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.298511    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 19:51:40.299078 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.299058    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zftpm\""
Jul 06 19:51:40.307417 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.307390    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 19:51:40.307988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.307968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d5fdddbfc-xwvqf"]
Jul 06 19:51:40.308064 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.308025    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"]
Jul 06 19:51:40.308123 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.308102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"
Jul 06 19:51:40.310113 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.310088    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"]
Jul 06 19:51:40.314554 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.314509    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.314907 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.314879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2brr8\""
Jul 06 19:51:40.315042 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.315027    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.329612 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.329578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/812c743f-98d3-42a9-8ba6-08b7ec614f6f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.329794 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.329635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:40.329794 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.329666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwgx\" (UniqueName: \"kubernetes.io/projected/0679ec6c-b695-4204-ad3b-fb93d57bef67-kube-api-access-fvwgx\") pod \"network-check-source-989f8b8dc-t6rww\" (UID: \"0679ec6c-b695-4204-ad3b-fb93d57bef67\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"
Jul 06 19:51:40.329794 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.329757    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:51:40.329794 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.329774    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b44b8988c-qzbzz: secret "image-registry-tls" not found
Jul 06 19:51:40.330049 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.329803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/118802f9-1420-4ad4-bc20-76d17dcb7871-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.330049 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.329846    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls podName:e7660ad3-3a21-4481-be80-f3101f61c134 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:42.329824236 +0000 UTC m=+41.713482983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls") pod "image-registry-7b44b8988c-qzbzz" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134") : secret "image-registry-tls" not found
Jul 06 19:51:40.330049 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.329942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws9d8\" (UniqueName: \"kubernetes.io/projected/118802f9-1420-4ad4-bc20-76d17dcb7871-kube-api-access-ws9d8\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.330049 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.329982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/812c743f-98d3-42a9-8ba6-08b7ec614f6f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.330049 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.330008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dhcf\" (UniqueName: \"kubernetes.io/projected/812c743f-98d3-42a9-8ba6-08b7ec614f6f-kube-api-access-2dhcf\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.330319 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.330091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.332768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.332075    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-5lnsq"]
Jul 06 19:51:40.332768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.332234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.333545 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.333492    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:40.335216 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.335193    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 19:51:40.335600 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.335578    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 19:51:40.335686 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.335579    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ltfx8\""
Jul 06 19:51:40.335825 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.335805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.336188 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.336069    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.356301 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.356272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"]
Jul 06 19:51:40.356485 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.356312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-5lnsq"]
Jul 06 19:51:40.356485 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.356427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.358723 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.358696    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vt5gm\""
Jul 06 19:51:40.358995 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.358975    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 19:51:40.359067 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.359033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.359122 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.358982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.359285 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.359268    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 19:51:40.365452 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.365425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 19:51:40.394104 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.394072    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"]
Jul 06 19:51:40.412451 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.412351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:40.416653 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.416626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 19:51:40.416859 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.416674    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l97pz\""
Jul 06 19:51:40.416955 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.416938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 19:51:40.417384 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.417338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:40.426577 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.426530    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"]
Jul 06 19:51:40.431438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d39e8d-7fd5-4c0e-9259-559e644c186c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.431563 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/79d39e8d-7fd5-4c0e-9259-559e644c186c-snapshots\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.431563 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/812c743f-98d3-42a9-8ba6-08b7ec614f6f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.431563 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7sb5\" (UniqueName: \"kubernetes.io/projected/0086c444-b11c-46bd-8633-645ef7f30846-kube-api-access-s7sb5\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.431563 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-config\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.431743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.431743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.431743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/812c743f-98d3-42a9-8ba6-08b7ec614f6f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.431743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0086c444-b11c-46bd-8633-645ef7f30846-config\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.431743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0086c444-b11c-46bd-8633-645ef7f30846-serving-cert\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.431941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr5gw\" (UniqueName: \"kubernetes.io/projected/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-kube-api-access-tr5gw\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.431941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.431941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d39e8d-7fd5-4c0e-9259-559e644c186c-tmp\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.431941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d39e8d-7fd5-4c0e-9259-559e644c186c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.432107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.431966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvwr4\" (UniqueName: \"kubernetes.io/projected/1ef9b330-0c0d-4e73-b91e-6c4511246202-kube-api-access-nvwr4\") pod \"volume-data-source-validator-5d456fdbcd-576n7\" (UID: \"1ef9b330-0c0d-4e73-b91e-6c4511246202\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"
Jul 06 19:51:40.432107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws9d8\" (UniqueName: \"kubernetes.io/projected/118802f9-1420-4ad4-bc20-76d17dcb7871-kube-api-access-ws9d8\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.432107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432024    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/812c743f-98d3-42a9-8ba6-08b7ec614f6f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.432107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dhcf\" (UniqueName: \"kubernetes.io/projected/812c743f-98d3-42a9-8ba6-08b7ec614f6f-kube-api-access-2dhcf\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.432107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432071    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0086c444-b11c-46bd-8633-645ef7f30846-trusted-ca\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.432107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbhp\" (UniqueName: \"kubernetes.io/projected/79d39e8d-7fd5-4c0e-9259-559e644c186c-kube-api-access-pfbhp\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.432189    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwgx\" (UniqueName: \"kubernetes.io/projected/0679ec6c-b695-4204-ad3b-fb93d57bef67-kube-api-access-fvwgx\") pod \"network-check-source-989f8b8dc-t6rww\" (UID: \"0679ec6c-b695-4204-ad3b-fb93d57bef67\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.432244    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls podName:118802f9-1420-4ad4-bc20-76d17dcb7871 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:40.932226984 +0000 UTC m=+40.315885732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zgbgn" (UID: "118802f9-1420-4ad4-bc20-76d17dcb7871") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/118802f9-1420-4ad4-bc20-76d17dcb7871-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79d39e8d-7fd5-4c0e-9259-559e644c186c-serving-cert\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-stats-auth\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.432349    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:40.432477 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.432437    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls podName:6f354a22-d010-4046-ad58-42edce5e8032 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:42.43241944 +0000 UTC m=+41.816078168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls") pod "dns-default-zrbbp" (UID: "6f354a22-d010-4046-ad58-42edce5e8032") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:40.433096 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-default-certificate\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.433096 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.432654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfgkf\" (UniqueName: \"kubernetes.io/projected/14d488ca-2078-490c-bab3-34e4044b0c7a-kube-api-access-gfgkf\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.433194 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.433100    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/118802f9-1420-4ad4-bc20-76d17dcb7871-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.434373 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.434328    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/812c743f-98d3-42a9-8ba6-08b7ec614f6f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.439432 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.439405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:40.457706 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.457677    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwgx\" (UniqueName: \"kubernetes.io/projected/0679ec6c-b695-4204-ad3b-fb93d57bef67-kube-api-access-fvwgx\") pod \"network-check-source-989f8b8dc-t6rww\" (UID: \"0679ec6c-b695-4204-ad3b-fb93d57bef67\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"
Jul 06 19:51:40.457918 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.457803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dhcf\" (UniqueName: \"kubernetes.io/projected/812c743f-98d3-42a9-8ba6-08b7ec614f6f-kube-api-access-2dhcf\") pod \"kube-storage-version-migrator-operator-846bf668f7-nmtkq\" (UID: \"812c743f-98d3-42a9-8ba6-08b7ec614f6f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.458734 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.458700    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws9d8\" (UniqueName: \"kubernetes.io/projected/118802f9-1420-4ad4-bc20-76d17dcb7871-kube-api-access-ws9d8\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.530010 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.529964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"
Jul 06 19:51:40.533322 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79d39e8d-7fd5-4c0e-9259-559e644c186c-serving-cert\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.533423 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-stats-auth\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.533423 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-default-certificate\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.533423 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfgkf\" (UniqueName: \"kubernetes.io/projected/14d488ca-2078-490c-bab3-34e4044b0c7a-kube-api-access-gfgkf\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.533423 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d39e8d-7fd5-4c0e-9259-559e644c186c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.533570 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/79d39e8d-7fd5-4c0e-9259-559e644c186c-snapshots\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.533570 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7sb5\" (UniqueName: \"kubernetes.io/projected/0086c444-b11c-46bd-8633-645ef7f30846-kube-api-access-s7sb5\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.533570 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-config\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.533697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bv6h\" (UniqueName: \"kubernetes.io/projected/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-kube-api-access-6bv6h\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:40.533697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.533697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.533697 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0086c444-b11c-46bd-8633-645ef7f30846-config\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.533911 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0086c444-b11c-46bd-8633-645ef7f30846-serving-cert\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.533911 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr5gw\" (UniqueName: \"kubernetes.io/projected/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-kube-api-access-tr5gw\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.533911 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.533911 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d39e8d-7fd5-4c0e-9259-559e644c186c-tmp\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.533911 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d39e8d-7fd5-4c0e-9259-559e644c186c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.533911 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwr4\" (UniqueName: \"kubernetes.io/projected/1ef9b330-0c0d-4e73-b91e-6c4511246202-kube-api-access-nvwr4\") pod \"volume-data-source-validator-5d456fdbcd-576n7\" (UID: \"1ef9b330-0c0d-4e73-b91e-6c4511246202\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"
Jul 06 19:51:40.534195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0086c444-b11c-46bd-8633-645ef7f30846-trusted-ca\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.534195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.533937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbhp\" (UniqueName: \"kubernetes.io/projected/79d39e8d-7fd5-4c0e-9259-559e644c186c-kube-api-access-pfbhp\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.534195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.534002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:40.534195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.534063    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/79d39e8d-7fd5-4c0e-9259-559e644c186c-snapshots\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.534195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.534073    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d39e8d-7fd5-4c0e-9259-559e644c186c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.534465 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.534203    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:51:40.534465 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.534357    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d39e8d-7fd5-4c0e-9259-559e644c186c-tmp\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.535271 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.534675    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-config\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.535271 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.534773    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:41.034753268 +0000 UTC m=+40.418411997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : configmap references non-existent config key: service-ca.crt
Jul 06 19:51:40.535271 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.535062    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:41.035046006 +0000 UTC m=+40.418704733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : secret "router-metrics-certs-default" not found
Jul 06 19:51:40.535271 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.535176    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79d39e8d-7fd5-4c0e-9259-559e644c186c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.535692 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.535604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0086c444-b11c-46bd-8633-645ef7f30846-trusted-ca\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.535692 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.535652    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0086c444-b11c-46bd-8633-645ef7f30846-config\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.536606 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.536575    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79d39e8d-7fd5-4c0e-9259-559e644c186c-serving-cert\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.536606 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.536593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-default-certificate\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.536831 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.536813    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.536890 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.536814    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0086c444-b11c-46bd-8633-645ef7f30846-serving-cert\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.537256 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.537239    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-stats-auth\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.541536 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.541518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"
Jul 06 19:51:40.543989 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.543961    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7sb5\" (UniqueName: \"kubernetes.io/projected/0086c444-b11c-46bd-8633-645ef7f30846-kube-api-access-s7sb5\") pod \"console-operator-68b757fb67-5lnsq\" (UID: \"0086c444-b11c-46bd-8633-645ef7f30846\") " pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.546468 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.546405    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbhp\" (UniqueName: \"kubernetes.io/projected/79d39e8d-7fd5-4c0e-9259-559e644c186c-kube-api-access-pfbhp\") pod \"insights-operator-5c847dcfc4-r5dtb\" (UID: \"79d39e8d-7fd5-4c0e-9259-559e644c186c\") " pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.546739 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.546716    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvwr4\" (UniqueName: \"kubernetes.io/projected/1ef9b330-0c0d-4e73-b91e-6c4511246202-kube-api-access-nvwr4\") pod \"volume-data-source-validator-5d456fdbcd-576n7\" (UID: \"1ef9b330-0c0d-4e73-b91e-6c4511246202\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"
Jul 06 19:51:40.547242 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.547223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr5gw\" (UniqueName: \"kubernetes.io/projected/8ab56dc7-8d91-4c39-a7fd-19209a255b8c-kube-api-access-tr5gw\") pod \"service-ca-operator-5d46d9ffd4-txtsc\" (UID: \"8ab56dc7-8d91-4c39-a7fd-19209a255b8c\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.548350 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.548332    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfgkf\" (UniqueName: \"kubernetes.io/projected/14d488ca-2078-490c-bab3-34e4044b0c7a-kube-api-access-gfgkf\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:40.574477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.574447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:40.607302 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.607267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb"
Jul 06 19:51:40.618442 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.618403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"
Jul 06 19:51:40.634504 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.634472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bv6h\" (UniqueName: \"kubernetes.io/projected/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-kube-api-access-6bv6h\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:40.634669 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.634567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:40.634728 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.634690    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:51:40.634773 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.634734    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls podName:7e351c67-a905-4aec-8dfd-9e09e09dcf7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:41.134721156 +0000 UTC m=+40.518379883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fpzzk" (UID: "7e351c67-a905-4aec-8dfd-9e09e09dcf7a") : secret "samples-operator-tls" not found
Jul 06 19:51:40.644023 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.644001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"
Jul 06 19:51:40.644615 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.644594    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bv6h\" (UniqueName: \"kubernetes.io/projected/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-kube-api-access-6bv6h\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:40.667555 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.667469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:40.673307 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.673274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:40.783264 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.782539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:40.834979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.834089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29kdl"]
Jul 06 19:51:40.839165 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.839094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq"]
Jul 06 19:51:40.855874 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.855803    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww"]
Jul 06 19:51:40.877501 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.877431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-r5dtb"]
Jul 06 19:51:40.891551 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:40.891386    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812c743f_98d3_42a9_8ba6_08b7ec614f6f.slice/crio-492d4d642dc5da4b15ab94a94c5c131239576767a35ec88ff322c4b02551f373 WatchSource:0}: Error finding container 492d4d642dc5da4b15ab94a94c5c131239576767a35ec88ff322c4b02551f373: Status 404 returned error can't find the container with id 492d4d642dc5da4b15ab94a94c5c131239576767a35ec88ff322c4b02551f373
Jul 06 19:51:40.892329 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:40.892027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341589de_3337_415a_a791_37875cd49f36.slice/crio-96b2d20dfa3b532a2e55d6d22a4fe585736b6cdc0e6742c6612717a8b58d64ca WatchSource:0}: Error finding container 96b2d20dfa3b532a2e55d6d22a4fe585736b6cdc0e6742c6612717a8b58d64ca: Status 404 returned error can't find the container with id 96b2d20dfa3b532a2e55d6d22a4fe585736b6cdc0e6742c6612717a8b58d64ca
Jul 06 19:51:40.917000 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.916970    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7"]
Jul 06 19:51:40.923711 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:40.923680    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef9b330_0c0d_4e73_b91e_6c4511246202.slice/crio-383612eb36330badd0bdbf8daad7978e36e021803c3a4f42400a4405b83af72a WatchSource:0}: Error finding container 383612eb36330badd0bdbf8daad7978e36e021803c3a4f42400a4405b83af72a: Status 404 returned error can't find the container with id 383612eb36330badd0bdbf8daad7978e36e021803c3a4f42400a4405b83af72a
Jul 06 19:51:40.929213 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.929189    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-5lnsq"]
Jul 06 19:51:40.932777 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:40.932756    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0086c444_b11c_46bd_8633_645ef7f30846.slice/crio-974d20a0b6d33b6fdc4030b7cb88bd36efe02664b6cbd4a532b3f8547a9bba3c WatchSource:0}: Error finding container 974d20a0b6d33b6fdc4030b7cb88bd36efe02664b6cbd4a532b3f8547a9bba3c: Status 404 returned error can't find the container with id 974d20a0b6d33b6fdc4030b7cb88bd36efe02664b6cbd4a532b3f8547a9bba3c
Jul 06 19:51:40.937235 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.937210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:40.937331 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.937318    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:40.937429 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:40.937395    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls podName:118802f9-1420-4ad4-bc20-76d17dcb7871 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:41.937376367 +0000 UTC m=+41.321035109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zgbgn" (UID: "118802f9-1420-4ad4-bc20-76d17dcb7871") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:40.948252 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:40.948227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc"]
Jul 06 19:51:40.951837 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:40.951816    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab56dc7_8d91_4c39_a7fd_19209a255b8c.slice/crio-d7408d6cfd391aef3a02614b995ab4267846fd6a0b58749736846a1122d67dac WatchSource:0}: Error finding container d7408d6cfd391aef3a02614b995ab4267846fd6a0b58749736846a1122d67dac: Status 404 returned error can't find the container with id d7408d6cfd391aef3a02614b995ab4267846fd6a0b58749736846a1122d67dac
Jul 06 19:51:41.037672 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.037646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:41.037816 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.037702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:41.037816 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.037803    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:42.037788177 +0000 UTC m=+41.421446924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : configmap references non-existent config key: service-ca.crt
Jul 06 19:51:41.037932 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.037825    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:51:41.037932 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.037896    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:42.03787778 +0000 UTC m=+41.421536528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : secret "router-metrics-certs-default" not found
Jul 06 19:51:41.138987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.138947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:41.139139 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.139102    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:51:41.139180 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.139170    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls podName:7e351c67-a905-4aec-8dfd-9e09e09dcf7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:42.139153816 +0000 UTC m=+41.522812546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fpzzk" (UID: "7e351c67-a905-4aec-8dfd-9e09e09dcf7a") : secret "samples-operator-tls" not found
Jul 06 19:51:41.258167 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.258135    2581 generic.go:356] "Generic (PLEG): container finished" podID="19c7e58d-3e30-4a72-80fe-a83a96eaf902" containerID="de579ba7fbd556fc4451f94bfd5db92caf2f4b237ccf0000a4ecfb46cbd80da5" exitCode=0
Jul 06 19:51:41.258758 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.258203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerDied","Data":"de579ba7fbd556fc4451f94bfd5db92caf2f4b237ccf0000a4ecfb46cbd80da5"}
Jul 06 19:51:41.259407 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.259384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb" event={"ID":"79d39e8d-7fd5-4c0e-9259-559e644c186c","Type":"ContainerStarted","Data":"31603ddd0b912e558b9860ec429e284d58d4fea9549f76e5f9df54646fb25e9f"}
Jul 06 19:51:41.260472 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.260446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww" event={"ID":"0679ec6c-b695-4204-ad3b-fb93d57bef67","Type":"ContainerStarted","Data":"5714cf0da224f6323aa2f5f44599c1a75dffa105526d047a767955dcd454a9c9"}
Jul 06 19:51:41.261633 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.261614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq" event={"ID":"812c743f-98d3-42a9-8ba6-08b7ec614f6f","Type":"ContainerStarted","Data":"492d4d642dc5da4b15ab94a94c5c131239576767a35ec88ff322c4b02551f373"}
Jul 06 19:51:41.262824 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.262804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" event={"ID":"0086c444-b11c-46bd-8633-645ef7f30846","Type":"ContainerStarted","Data":"974d20a0b6d33b6fdc4030b7cb88bd36efe02664b6cbd4a532b3f8547a9bba3c"}
Jul 06 19:51:41.263925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.263899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7" event={"ID":"1ef9b330-0c0d-4e73-b91e-6c4511246202","Type":"ContainerStarted","Data":"383612eb36330badd0bdbf8daad7978e36e021803c3a4f42400a4405b83af72a"}
Jul 06 19:51:41.264896 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.264875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc" event={"ID":"8ab56dc7-8d91-4c39-a7fd-19209a255b8c","Type":"ContainerStarted","Data":"d7408d6cfd391aef3a02614b995ab4267846fd6a0b58749736846a1122d67dac"}
Jul 06 19:51:41.265936 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.265911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29kdl" event={"ID":"341589de-3337-415a-a791-37875cd49f36","Type":"ContainerStarted","Data":"96b2d20dfa3b532a2e55d6d22a4fe585736b6cdc0e6742c6612717a8b58d64ca"}
Jul 06 19:51:41.417630 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.417578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:41.792473 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.792296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:41.854030 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.853972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:41.951161 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:41.950916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:41.951830 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.951343    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:41.951830 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:41.951446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls podName:118802f9-1420-4ad4-bc20-76d17dcb7871 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:43.951423223 +0000 UTC m=+43.335081955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zgbgn" (UID: "118802f9-1420-4ad4-bc20-76d17dcb7871") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:42.052420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.051564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:42.052420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.051653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:42.052420 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.051889    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:51:42.052420 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.051953    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:44.051934022 +0000 UTC m=+43.435592764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : secret "router-metrics-certs-default" not found
Jul 06 19:51:42.052420 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.052356    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:44.052340916 +0000 UTC m=+43.435999657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : configmap references non-existent config key: service-ca.crt
Jul 06 19:51:42.153491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.152933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:42.153491 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.153066    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:51:42.153491 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.153132    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls podName:7e351c67-a905-4aec-8dfd-9e09e09dcf7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:44.153112779 +0000 UTC m=+43.536771509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fpzzk" (UID: "7e351c67-a905-4aec-8dfd-9e09e09dcf7a") : secret "samples-operator-tls" not found
Jul 06 19:51:42.281708 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.281670    2581 generic.go:356] "Generic (PLEG): container finished" podID="19c7e58d-3e30-4a72-80fe-a83a96eaf902" containerID="835e049ed56ac17715e4f14fa2bb2baf43bd5dc326cca3058c11aad66b91cd80" exitCode=0
Jul 06 19:51:42.282161 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.281725    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerDied","Data":"835e049ed56ac17715e4f14fa2bb2baf43bd5dc326cca3058c11aad66b91cd80"}
Jul 06 19:51:42.355176 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.354195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:42.355176 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.354738    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:51:42.355176 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.354754    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b44b8988c-qzbzz: secret "image-registry-tls" not found
Jul 06 19:51:42.355176 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.354810    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls podName:e7660ad3-3a21-4481-be80-f3101f61c134 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:46.354791187 +0000 UTC m=+45.738449914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls") pod "image-registry-7b44b8988c-qzbzz" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134") : secret "image-registry-tls" not found
Jul 06 19:51:42.456582 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:42.456553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:42.457717 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.457160    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:42.457717 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:42.457222    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls podName:6f354a22-d010-4046-ad58-42edce5e8032 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:46.457202631 +0000 UTC m=+45.840861359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls") pod "dns-default-zrbbp" (UID: "6f354a22-d010-4046-ad58-42edce5e8032") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:43.291173 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:43.291136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" event={"ID":"19c7e58d-3e30-4a72-80fe-a83a96eaf902","Type":"ContainerStarted","Data":"d0663154fc51e31fa47053f700d3fce0f8034876e47aeda255ee5b33ffc372a6"}
Jul 06 19:51:43.317121 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:43.317070    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qkjf2" podStartSLOduration=11.827430416 podStartE2EDuration="41.317053756s" totalImagesPullingTime="29.48962334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:43.316525146 +0000 UTC m=+42.700183896" watchObservedRunningTime="2026-07-06 19:51:43.317053756 +0000 UTC m=+42.700712504"
Jul 06 19:51:43.490178 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:43.490145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:43.631475 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:43.631345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:43.973521 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:43.973430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:43.973672 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:43.973597    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:43.973672 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:43.973671    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls podName:118802f9-1420-4ad4-bc20-76d17dcb7871 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:47.973655178 +0000 UTC m=+47.357313908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zgbgn" (UID: "118802f9-1420-4ad4-bc20-76d17dcb7871") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:44.074213 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:44.074176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:44.074396 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:44.074233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:44.074396 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:44.074335    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:51:44.074396 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:44.074380    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:48.074342412 +0000 UTC m=+47.458001142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : configmap references non-existent config key: service-ca.crt
Jul 06 19:51:44.074574 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:44.074411    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:48.074399794 +0000 UTC m=+47.458058521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : secret "router-metrics-certs-default" not found
Jul 06 19:51:44.175557 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:44.175517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:44.175709 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:44.175677    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:51:44.175770 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:44.175746    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls podName:7e351c67-a905-4aec-8dfd-9e09e09dcf7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:48.17573137 +0000 UTC m=+47.559390096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fpzzk" (UID: "7e351c67-a905-4aec-8dfd-9e09e09dcf7a") : secret "samples-operator-tls" not found
Jul 06 19:51:44.246292 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:44.246190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:44.387015 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:44.386976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:46.397937 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:46.397895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:46.398831 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:46.398074    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:51:46.398831 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:46.398100    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b44b8988c-qzbzz: secret "image-registry-tls" not found
Jul 06 19:51:46.398831 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:46.398168    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls podName:e7660ad3-3a21-4481-be80-f3101f61c134 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:54.39814566 +0000 UTC m=+53.781804390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls") pod "image-registry-7b44b8988c-qzbzz" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134") : secret "image-registry-tls" not found
Jul 06 19:51:46.498732 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:46.498695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:46.498905 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:46.498846    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:46.498945 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:46.498910    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls podName:6f354a22-d010-4046-ad58-42edce5e8032 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:54.498895011 +0000 UTC m=+53.882553756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls") pod "dns-default-zrbbp" (UID: "6f354a22-d010-4046-ad58-42edce5e8032") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:48.011750 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:48.011693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:48.012199 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.011876    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:48.012199 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.011968    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls podName:118802f9-1420-4ad4-bc20-76d17dcb7871 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.011946644 +0000 UTC m=+55.395605387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zgbgn" (UID: "118802f9-1420-4ad4-bc20-76d17dcb7871") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:48.112460 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:48.112413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:48.112625 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:48.112502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:48.112625 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.112611    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.112589881 +0000 UTC m=+55.496248632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : configmap references non-existent config key: service-ca.crt
Jul 06 19:51:48.112756 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.112683    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:51:48.112756 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.112750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.112732612 +0000 UTC m=+55.496391340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : secret "router-metrics-certs-default" not found
Jul 06 19:51:48.213797 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:48.213754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:48.213990 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.213891    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:51:48.213990 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:48.213985    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls podName:7e351c67-a905-4aec-8dfd-9e09e09dcf7a nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.213963461 +0000 UTC m=+55.597622204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fpzzk" (UID: "7e351c67-a905-4aec-8dfd-9e09e09dcf7a") : secret "samples-operator-tls" not found
Jul 06 19:51:49.310749 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.310692    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc" event={"ID":"8ab56dc7-8d91-4c39-a7fd-19209a255b8c","Type":"ContainerStarted","Data":"e1b18296f818bb1e1614ef6ae4b7191ec2439628237f937112d694695c58d0d3"}
Jul 06 19:51:49.316521 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.316486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29kdl" event={"ID":"341589de-3337-415a-a791-37875cd49f36","Type":"ContainerStarted","Data":"21effc3fcbfc2a41340e9691f7bd16e525dd918c65daebbba4cd7780194799a9"}
Jul 06 19:51:49.318039 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.318010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb" event={"ID":"79d39e8d-7fd5-4c0e-9259-559e644c186c","Type":"ContainerStarted","Data":"495cb7902c6503bad6f3c809a3fe403f24ca0ed50015217ce193034a700e14ee"}
Jul 06 19:51:49.319982 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.319954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww" event={"ID":"0679ec6c-b695-4204-ad3b-fb93d57bef67","Type":"ContainerStarted","Data":"8b8e19c42cef1019ed6c9332d266e865e5c508e4e8fdfa16438f695ef1f2cd5e"}
Jul 06 19:51:49.322668 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.322642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq" event={"ID":"812c743f-98d3-42a9-8ba6-08b7ec614f6f","Type":"ContainerStarted","Data":"413a83b6443ac71f4d06cdaf35603e237b26729161a5e28b1f96337f28a7ec3f"}
Jul 06 19:51:49.324632 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.324611    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/0.log"
Jul 06 19:51:49.324632 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.324653    2581 generic.go:356] "Generic (PLEG): container finished" podID="0086c444-b11c-46bd-8633-645ef7f30846" containerID="829b8e232b0c6de80941b1e5e1be8e63c2ab7579bc6398bc5e509a1476f3da0c" exitCode=255
Jul 06 19:51:49.324632 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.324731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" event={"ID":"0086c444-b11c-46bd-8633-645ef7f30846","Type":"ContainerDied","Data":"829b8e232b0c6de80941b1e5e1be8e63c2ab7579bc6398bc5e509a1476f3da0c"}
Jul 06 19:51:49.324632 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.324872    2581 scope.go:117] "RemoveContainer" containerID="829b8e232b0c6de80941b1e5e1be8e63c2ab7579bc6398bc5e509a1476f3da0c"
Jul 06 19:51:49.326766 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.326745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7" event={"ID":"1ef9b330-0c0d-4e73-b91e-6c4511246202","Type":"ContainerStarted","Data":"41e89edb2c7051db5332099b4b62e9c169ef223e41df7c8c5a912d76698ff6e3"}
Jul 06 19:51:49.334347 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.334204    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc" podStartSLOduration=1.612678952 podStartE2EDuration="9.334188753s" totalImagesPullingTime="7.721509801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:49.333017518 +0000 UTC m=+48.716676268" watchObservedRunningTime="2026-07-06 19:51:49.334188753 +0000 UTC m=+48.717847502"
Jul 06 19:51:49.358847 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.358757    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-t6rww" podStartSLOduration=1.606251205 podStartE2EDuration="9.358732861s" totalImagesPullingTime="7.752481656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:49.357621507 +0000 UTC m=+48.741280257" watchObservedRunningTime="2026-07-06 19:51:49.358732861 +0000 UTC m=+48.742391593"
Jul 06 19:51:49.389632 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.389573    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq" podStartSLOduration=1.637328164 podStartE2EDuration="9.389550297s" totalImagesPullingTime="7.752222133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:49.388644378 +0000 UTC m=+48.772303127" watchObservedRunningTime="2026-07-06 19:51:49.389550297 +0000 UTC m=+48.773209045"
Jul 06 19:51:49.436797 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.436519    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb" podStartSLOduration=1.68476834 podStartE2EDuration="9.436497876s" totalImagesPullingTime="7.751729536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:49.411973221 +0000 UTC m=+48.795631973" watchObservedRunningTime="2026-07-06 19:51:49.436497876 +0000 UTC m=+48.820156626"
Jul 06 19:51:49.436797 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.436633    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-576n7" podStartSLOduration=1.7369726349999999 podStartE2EDuration="9.436626022s" totalImagesPullingTime="7.699653387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:49.434928486 +0000 UTC m=+48.818587237" watchObservedRunningTime="2026-07-06 19:51:49.436626022 +0000 UTC m=+48.820284775"
Jul 06 19:51:49.678543 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.678452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:49.787685 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.787650    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:49.958347 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:49.958249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:50.327956 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.327921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:50.333394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.333350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 19:51:50.333815 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.333764    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/0.log"
Jul 06 19:51:50.333815 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.333807    2581 generic.go:356] "Generic (PLEG): container finished" podID="0086c444-b11c-46bd-8633-645ef7f30846" containerID="127ea44775a4170f2388bb1ea078d73c245000439f9208956b4fa6d19fad445b" exitCode=255
Jul 06 19:51:50.333989 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.333895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" event={"ID":"0086c444-b11c-46bd-8633-645ef7f30846","Type":"ContainerDied","Data":"127ea44775a4170f2388bb1ea078d73c245000439f9208956b4fa6d19fad445b"}
Jul 06 19:51:50.333989 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.333971    2581 scope.go:117] "RemoveContainer" containerID="829b8e232b0c6de80941b1e5e1be8e63c2ab7579bc6398bc5e509a1476f3da0c"
Jul 06 19:51:50.334403 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.334383    2581 scope.go:117] "RemoveContainer" containerID="127ea44775a4170f2388bb1ea078d73c245000439f9208956b4fa6d19fad445b"
Jul 06 19:51:50.334595 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:50.334572    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-5lnsq_openshift-console-operator(0086c444-b11c-46bd-8633-645ef7f30846)\"" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" podUID="0086c444-b11c-46bd-8633-645ef7f30846"
Jul 06 19:51:50.410157 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.410091    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-29kdl" podStartSLOduration=4.657394426 podStartE2EDuration="12.410067085s" totalImagesPullingTime="7.752672659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:49.516130904 +0000 UTC m=+48.899789655" watchObservedRunningTime="2026-07-06 19:51:50.410067085 +0000 UTC m=+49.793725836"
Jul 06 19:51:50.522116 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.522077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:50.616326 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.616230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:50.667977 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.667926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:50.668161 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.668032    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:51:50.971310 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:50.971227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:51.094997 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.093488    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:51.122106 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.122070    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5lrcz"]
Jul 06 19:51:51.147353 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.147318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lrcz"]
Jul 06 19:51:51.147538 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.147482    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.150671 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.150648    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:51:51.150812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.150651    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:51:51.151094 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.151082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-72blj\""
Jul 06 19:51:51.179237 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.179200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:51.237594 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.237517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31805ed6-206c-4c30-9e5b-2793c0a2f62f-data-volume\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.237594 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.237571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthxl\" (UniqueName: \"kubernetes.io/projected/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-api-access-zthxl\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.237811 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.237705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.237811 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.237762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.237811 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.237805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31805ed6-206c-4c30-9e5b-2793c0a2f62f-crio-socket\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.268093 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.268058    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"]
Jul 06 19:51:51.291543 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.291512    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"]
Jul 06 19:51:51.291690 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.291634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"
Jul 06 19:51:51.294955 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.294930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nbb8j\""
Jul 06 19:51:51.295106 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.294930    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 19:51:51.295106 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.294934    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 19:51:51.313010 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.312972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:51.338332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31805ed6-206c-4c30-9e5b-2793c0a2f62f-crio-socket\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.338462    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.338501    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31805ed6-206c-4c30-9e5b-2793c0a2f62f-data-volume\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.338538    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:51.838522092 +0000 UTC m=+51.222180820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.338568    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:51.838550269 +0000 UTC m=+51.222209019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : configmap "kube-rbac-proxy" not found
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthxl\" (UniqueName: \"kubernetes.io/projected/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-api-access-zthxl\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rswfk\" (UniqueName: \"kubernetes.io/projected/2f691a1d-51c1-4f39-9da7-63694a058d94-kube-api-access-rswfk\") pod \"migrator-d57d58cc9-wlm94\" (UID: \"2f691a1d-51c1-4f39-9da7-63694a058d94\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338750    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31805ed6-206c-4c30-9e5b-2793c0a2f62f-crio-socket\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.338806 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338810    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31805ed6-206c-4c30-9e5b-2793c0a2f62f-data-volume\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.339169 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.338825    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 19:51:51.339169 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.339111    2581 scope.go:117] "RemoveContainer" containerID="127ea44775a4170f2388bb1ea078d73c245000439f9208956b4fa6d19fad445b"
Jul 06 19:51:51.339259 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.339240    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-5lnsq_openshift-console-operator(0086c444-b11c-46bd-8633-645ef7f30846)\"" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" podUID="0086c444-b11c-46bd-8633-645ef7f30846"
Jul 06 19:51:51.352267 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.352222    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthxl\" (UniqueName: \"kubernetes.io/projected/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-api-access-zthxl\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.412840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.412801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:51.439888 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.439851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rswfk\" (UniqueName: \"kubernetes.io/projected/2f691a1d-51c1-4f39-9da7-63694a058d94-kube-api-access-rswfk\") pod \"migrator-d57d58cc9-wlm94\" (UID: \"2f691a1d-51c1-4f39-9da7-63694a058d94\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"
Jul 06 19:51:51.448524 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.448489    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rswfk\" (UniqueName: \"kubernetes.io/projected/2f691a1d-51c1-4f39-9da7-63694a058d94-kube-api-access-rswfk\") pod \"migrator-d57d58cc9-wlm94\" (UID: \"2f691a1d-51c1-4f39-9da7-63694a058d94\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"
Jul 06 19:51:51.601236 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.601202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"
Jul 06 19:51:51.783786 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.783750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94"]
Jul 06 19:51:51.789196 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:51:51.789167    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f691a1d_51c1_4f39_9da7_63694a058d94.slice/crio-dd3d71302e48c7740d276364b12655fe2eb7522e3016b806b00b7fd5bd5ee571 WatchSource:0}: Error finding container dd3d71302e48c7740d276364b12655fe2eb7522e3016b806b00b7fd5bd5ee571: Status 404 returned error can't find the container with id dd3d71302e48c7740d276364b12655fe2eb7522e3016b806b00b7fd5bd5ee571
Jul 06 19:51:51.844291 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.844249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.844471 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:51.844303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:51.844471 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.844424    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:51.844471 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.844446    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:51:51.844569 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.844484    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:52.844470885 +0000 UTC m=+52.228129613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:51.844569 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:51.844507    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:52.844492515 +0000 UTC m=+52.228151243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : configmap "kube-rbac-proxy" not found
Jul 06 19:51:52.343386 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:52.343330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94" event={"ID":"2f691a1d-51c1-4f39-9da7-63694a058d94","Type":"ContainerStarted","Data":"dd3d71302e48c7740d276364b12655fe2eb7522e3016b806b00b7fd5bd5ee571"}
Jul 06 19:51:52.343753 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:52.343678    2581 scope.go:117] "RemoveContainer" containerID="127ea44775a4170f2388bb1ea078d73c245000439f9208956b4fa6d19fad445b"
Jul 06 19:51:52.343841 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:52.343822    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-5lnsq_openshift-console-operator(0086c444-b11c-46bd-8633-645ef7f30846)\"" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" podUID="0086c444-b11c-46bd-8633-645ef7f30846"
Jul 06 19:51:52.513131 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:52.513105    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s7p65_47de195d-218a-4489-9e81-d587a196ae7f/dns-node-resolver/0.log"
Jul 06 19:51:52.852330 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:52.852291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:52.852525 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:52.852337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:52.852525 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:52.852432    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:51:52.852525 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:52.852459    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:52.852525 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:52.852519    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:54.852496506 +0000 UTC m=+54.236155234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : configmap "kube-rbac-proxy" not found
Jul 06 19:51:52.852696 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:52.852539    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:54.852528455 +0000 UTC m=+54.236187184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:52.928129 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:52.928085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:53.020153 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:53.020120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:53.514483 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:53.514452    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sqwmf_3f7ce1ef-fedf-498b-87fe-9b898c13fb77/node-ca/0.log"
Jul 06 19:51:53.914270 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:53.914248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-29kdl_341589de-3337-415a-a791-37875cd49f36/serve-healthcheck-canary/0.log"
Jul 06 19:51:54.079281 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.079250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:54.351756 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.351721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94" event={"ID":"2f691a1d-51c1-4f39-9da7-63694a058d94","Type":"ContainerStarted","Data":"19ce9c3edcfeebd3d790ff6629e239e6877c9a8bf7d6ec55562fd9fd0ed557b8"}
Jul 06 19:51:54.351905 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.351779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94" event={"ID":"2f691a1d-51c1-4f39-9da7-63694a058d94","Type":"ContainerStarted","Data":"cd26cb8f19d08caad848d5d0dfe1178c1b2fbf8b8657216410fdfc85d7cb9b5a"}
Jul 06 19:51:54.377448 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.377398    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-wlm94" podStartSLOduration=1.288240408 podStartE2EDuration="3.37738104s" totalImagesPullingTime="2.089140632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:54.375508651 +0000 UTC m=+53.759167400" watchObservedRunningTime="2026-07-06 19:51:54.37738104 +0000 UTC m=+53.761039783"
Jul 06 19:51:54.468192 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.468157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:51:54.468358 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.468310    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:51:54.468358 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.468332    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b44b8988c-qzbzz: secret "image-registry-tls" not found
Jul 06 19:51:54.468455 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.468396    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls podName:e7660ad3-3a21-4481-be80-f3101f61c134 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:10.468381892 +0000 UTC m=+69.852040622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls") pod "image-registry-7b44b8988c-qzbzz" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134") : secret "image-registry-tls" not found
Jul 06 19:51:54.568987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.568947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:51:54.569398 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.569105    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:54.569398 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.569168    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls podName:6f354a22-d010-4046-ad58-42edce5e8032 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:10.569153251 +0000 UTC m=+69.952811978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls") pod "dns-default-zrbbp" (UID: "6f354a22-d010-4046-ad58-42edce5e8032") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:54.871466 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.871425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:54.871466 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:54.871469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:54.871668 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.871607    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:54.871707 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.871681    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:58.871664097 +0000 UTC m=+58.255322824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:54.871745 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.871616    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:51:54.871783 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:54.871751    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:51:58.871740088 +0000 UTC m=+58.255398816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : configmap "kube-rbac-proxy" not found
Jul 06 19:51:56.083347 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:56.083302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:51:56.083759 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.083494    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:56.083759 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.083596    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls podName:118802f9-1420-4ad4-bc20-76d17dcb7871 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:12.083572936 +0000 UTC m=+71.467231684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-zgbgn" (UID: "118802f9-1420-4ad4-bc20-76d17dcb7871") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:51:56.120590 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:56.120547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:56.184337 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:56.184298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:56.184540 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:56.184388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:51:56.184540 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.184492    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:52:12.184475217 +0000 UTC m=+71.568133963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : configmap references non-existent config key: service-ca.crt
Jul 06 19:51:56.184540 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.184505    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:51:56.184723 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.184573    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs podName:14d488ca-2078-490c-bab3-34e4044b0c7a nodeName:}" failed. No retries permitted until 2026-07-06 19:52:12.184553318 +0000 UTC m=+71.568212063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs") pod "router-default-d5fdddbfc-xwvqf" (UID: "14d488ca-2078-490c-bab3-34e4044b0c7a") : secret "router-metrics-certs-default" not found
Jul 06 19:51:56.215032 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:56.214996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:56.285559 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:56.285518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:51:56.285728 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.285620    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:51:56.285728 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:56.285697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls podName:7e351c67-a905-4aec-8dfd-9e09e09dcf7a nodeName:}" failed. No retries permitted until 2026-07-06 19:52:12.285682115 +0000 UTC m=+71.669340846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fpzzk" (UID: "7e351c67-a905-4aec-8dfd-9e09e09dcf7a") : secret "samples-operator-tls" not found
Jul 06 19:51:57.356260 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:57.356216    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:57.457734 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:57.457697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:57.558066 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:57.558028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:57.634671 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:57.634588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:58.875500 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:58.875465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:58.906766 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:58.906729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:58.906951 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:58.906781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:51:58.906951 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:58.906863    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:51:58.906951 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:58.906878    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:58.906951 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:58.906938    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:52:06.906922369 +0000 UTC m=+66.290581099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:51:58.906951 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:51:58.906955    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:52:06.906947708 +0000 UTC m=+66.290606473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : configmap "kube-rbac-proxy" not found
Jul 06 19:51:59.164179 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:59.164095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:59.279945 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:59.279897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:59.460475 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:59.460352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:59.777107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:51:59.777018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:00.561150 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:00.561107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:00.765729 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:00.765698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:00.966167 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:00.966076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:01.363788 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:01.363750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:01.767936 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:01.767848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:02.574439 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:02.574408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:02.678140 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:02.678096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:02.962627 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:02.962543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:03.168886 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:03.168849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:03.364803 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:03.364768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:03.433561 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:03.433529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:03.574556 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:03.574524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.245655 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:04.245624    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9znfc"
Jul 06 19:52:04.569899 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:04.569860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.964788 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:04.964693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:05.152543 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:05.152508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:05.238077 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:05.237986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:05.377849 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:05.377811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:05.569575 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:05.569536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:06.348982 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.348952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:06.443113 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.443078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:06.883236 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.883199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:52:06.883495 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.883241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:52:06.883495 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.883295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:52:06.885590 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.885564    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:52:06.885956 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.885938    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cl7r\" (UniqueName: \"kubernetes.io/projected/70c9ec68-2078-4ec5-903b-8656846e34d4-kube-api-access-6cl7r\") pod \"network-check-target-rxg5m\" (UID: \"70c9ec68-2078-4ec5-903b-8656846e34d4\") " pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:52:06.886023 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.885940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:52:06.896941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.896916    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d888d61-1772-4107-9062-d0fda5faf22a-metrics-certs\") pod \"network-metrics-daemon-gkvkc\" (UID: \"3d888d61-1772-4107-9062-d0fda5faf22a\") " pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:52:06.897062 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.896966    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3-original-pull-secret\") pod \"global-pull-secret-syncer-b8z2d\" (UID: \"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3\") " pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:52:06.929547 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.929510    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8z2d"
Jul 06 19:52:06.937712 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.937689    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hp2zw\""
Jul 06 19:52:06.943306 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.943285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c45tr\""
Jul 06 19:52:06.946033 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.946012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:52:06.952297 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.952273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkvkc"
Jul 06 19:52:06.960987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.960956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:06.984644 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.984533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:52:06.984644 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.984582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:52:06.985163 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:06.985142    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31805ed6-206c-4c30-9e5b-2793c0a2f62f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:52:06.985305 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:52:06.985261    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:52:06.985415 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:52:06.985322    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls podName:31805ed6-206c-4c30-9e5b-2793c0a2f62f nodeName:}" failed. No retries permitted until 2026-07-06 19:52:22.98530435 +0000 UTC m=+82.368963077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lrcz" (UID: "31805ed6-206c-4c30-9e5b-2793c0a2f62f") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:52:07.020937 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.019928    2581 scope.go:117] "RemoveContainer" containerID="127ea44775a4170f2388bb1ea078d73c245000439f9208956b4fa6d19fad445b"
Jul 06 19:52:07.088922 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.088892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8z2d"]
Jul 06 19:52:07.091643 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:07.091619    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f89b8fe_d2e4_4df0_b8d4_d543f0d49ab3.slice/crio-be5390db1f2a717cacfd4cb57cc234ba951f858530a06f5063a839016e66480f WatchSource:0}: Error finding container be5390db1f2a717cacfd4cb57cc234ba951f858530a06f5063a839016e66480f: Status 404 returned error can't find the container with id be5390db1f2a717cacfd4cb57cc234ba951f858530a06f5063a839016e66480f
Jul 06 19:52:07.158429 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.158314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:07.325028 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.324994    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxg5m"]
Jul 06 19:52:07.326262 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.326242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkvkc"]
Jul 06 19:52:07.328296 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:07.328267    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d888d61_1772_4107_9062_d0fda5faf22a.slice/crio-7471096b17f8a15f1208ad0d45903fe6993074530221c6cf8d693d363315194f WatchSource:0}: Error finding container 7471096b17f8a15f1208ad0d45903fe6993074530221c6cf8d693d363315194f: Status 404 returned error can't find the container with id 7471096b17f8a15f1208ad0d45903fe6993074530221c6cf8d693d363315194f
Jul 06 19:52:07.329028 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:07.329006    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c9ec68_2078_4ec5_903b_8656846e34d4.slice/crio-a0f64012f8a68aafee1ed683fcb626e3c46f8c15cc21a22b3a55eec51b47200c WatchSource:0}: Error finding container a0f64012f8a68aafee1ed683fcb626e3c46f8c15cc21a22b3a55eec51b47200c: Status 404 returned error can't find the container with id a0f64012f8a68aafee1ed683fcb626e3c46f8c15cc21a22b3a55eec51b47200c
Jul 06 19:52:07.374556 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.374526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:07.391005 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.390970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkvkc" event={"ID":"3d888d61-1772-4107-9062-d0fda5faf22a","Type":"ContainerStarted","Data":"7471096b17f8a15f1208ad0d45903fe6993074530221c6cf8d693d363315194f"}
Jul 06 19:52:07.392990 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.392970    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 19:52:07.393090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.393040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" event={"ID":"0086c444-b11c-46bd-8633-645ef7f30846","Type":"ContainerStarted","Data":"df42398a184f6e243b4bbd68225d10651bc8275a9429b7184c8c7412d4d88166"}
Jul 06 19:52:07.393482 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.393358    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:52:07.394664 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.394638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxg5m" event={"ID":"70c9ec68-2078-4ec5-903b-8656846e34d4","Type":"ContainerStarted","Data":"a0f64012f8a68aafee1ed683fcb626e3c46f8c15cc21a22b3a55eec51b47200c"}
Jul 06 19:52:07.394761 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.394688    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:52:07.396167 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.396146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8z2d" event={"ID":"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3","Type":"ContainerStarted","Data":"be5390db1f2a717cacfd4cb57cc234ba951f858530a06f5063a839016e66480f"}
Jul 06 19:52:07.415255 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.415150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq" podStartSLOduration=19.680982353 podStartE2EDuration="27.415133055s" totalImagesPullingTime="7.734150702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:07.414950659 +0000 UTC m=+66.798609409" watchObservedRunningTime="2026-07-06 19:52:07.415133055 +0000 UTC m=+66.798791810"
Jul 06 19:52:07.435782 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.435733    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rxg5m" podStartSLOduration=65.435715758 podStartE2EDuration="1m5.435715758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:07.435309449 +0000 UTC m=+66.818968199" watchObservedRunningTime="2026-07-06 19:52:07.435715758 +0000 UTC m=+66.819374507"
Jul 06 19:52:07.559576 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.559523    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:07.708480 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.708393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-5lnsq"
Jul 06 19:52:07.913435 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:07.913395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.013944 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.013828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.113660 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.113628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.214224 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.214183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.400819 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.400786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxg5m" event={"ID":"70c9ec68-2078-4ec5-903b-8656846e34d4","Type":"ContainerStarted","Data":"fb02327db25060097b1184c8e9b164fef0b08fcf76a0d48695b7459db57cdbd0"}
Jul 06 19:52:08.557655 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.557549    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.658477 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.658393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.988465 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:08.988407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.087674 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.087637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.187753 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.187649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.361992 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.361947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.406518 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.406482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkvkc" event={"ID":"3d888d61-1772-4107-9062-d0fda5faf22a","Type":"ContainerStarted","Data":"d927c1a61ee0624fa9b3fd219ad321b477f34822431452af6122d57a4d17ad79"}
Jul 06 19:52:09.406712 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.406546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkvkc" event={"ID":"3d888d61-1772-4107-9062-d0fda5faf22a","Type":"ContainerStarted","Data":"fba9206686122463e80dc7608f48a89c816acc88a18c51baa308f2dee35bcf9b"}
Jul 06 19:52:09.425634 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.425582    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gkvkc" podStartSLOduration=65.884099312 podStartE2EDuration="1m7.425560502s" totalImagesPullingTime="1.54146119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:09.423975611 +0000 UTC m=+68.807634358" watchObservedRunningTime="2026-07-06 19:52:09.425560502 +0000 UTC m=+68.809219254"
Jul 06 19:52:09.568098 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.568064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.672196 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.672159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.794972 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:09.794936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:10.032770 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.032681    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:10.441138 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.441096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:10.520604 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.520566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:52:10.523264 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.523239    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"image-registry-7b44b8988c-qzbzz\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") " pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:52:10.621645 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.621599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:52:10.624211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.624186    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f354a22-d010-4046-ad58-42edce5e8032-metrics-tls\") pod \"dns-default-zrbbp\" (UID: \"6f354a22-d010-4046-ad58-42edce5e8032\") " pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:52:10.686963 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.686928    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29xts\""
Jul 06 19:52:10.695664 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.695588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:52:10.804500 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.804469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wzh6g\""
Jul 06 19:52:10.812127 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:10.812103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:52:11.409063 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:11.408995    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zrbbp"]
Jul 06 19:52:11.413530 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:11.413506    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f354a22_d010_4046_ad58_42edce5e8032.slice/crio-b3c7fd426e55db6561cdb1eefa56b68f6650bb99f7aefc3513f82cbf47c8373d WatchSource:0}: Error finding container b3c7fd426e55db6561cdb1eefa56b68f6650bb99f7aefc3513f82cbf47c8373d: Status 404 returned error can't find the container with id b3c7fd426e55db6561cdb1eefa56b68f6650bb99f7aefc3513f82cbf47c8373d
Jul 06 19:52:11.433129 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:11.433104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b44b8988c-qzbzz"]
Jul 06 19:52:11.436017 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:11.435986    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7660ad3_3a21_4481_be80_f3101f61c134.slice/crio-da042662100fbfe609db312b327998bd7349535b212318f10def7751c5211f7d WatchSource:0}: Error finding container da042662100fbfe609db312b327998bd7349535b212318f10def7751c5211f7d: Status 404 returned error can't find the container with id da042662100fbfe609db312b327998bd7349535b212318f10def7751c5211f7d
Jul 06 19:52:12.136740 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.136695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:52:12.140604 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.140577    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/118802f9-1420-4ad4-bc20-76d17dcb7871-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-zgbgn\" (UID: \"118802f9-1420-4ad4-bc20-76d17dcb7871\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:52:12.237669 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.237619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:12.237842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.237693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:12.238284 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.238248    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d488ca-2078-490c-bab3-34e4044b0c7a-service-ca-bundle\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:12.240844 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.240816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d488ca-2078-490c-bab3-34e4044b0c7a-metrics-certs\") pod \"router-default-d5fdddbfc-xwvqf\" (UID: \"14d488ca-2078-490c-bab3-34e4044b0c7a\") " pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:12.339067 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.339035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:52:12.341656 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.341629    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e351c67-a905-4aec-8dfd-9e09e09dcf7a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fpzzk\" (UID: \"7e351c67-a905-4aec-8dfd-9e09e09dcf7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:52:12.367265 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.367238    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fsjmz\""
Jul 06 19:52:12.375188 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.375158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"
Jul 06 19:52:12.393628 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.393164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vpntw\""
Jul 06 19:52:12.401236 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.401187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:12.419635 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.419606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz" event={"ID":"e7660ad3-3a21-4481-be80-f3101f61c134","Type":"ContainerStarted","Data":"c3f3e1f3b2b02ce13e10fee3003ba3457330859d9fcc0ef0bab99eda540377a4"}
Jul 06 19:52:12.419759 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.419688    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz" event={"ID":"e7660ad3-3a21-4481-be80-f3101f61c134","Type":"ContainerStarted","Data":"da042662100fbfe609db312b327998bd7349535b212318f10def7751c5211f7d"}
Jul 06 19:52:12.419759 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.419717    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:52:12.420965 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.420936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zrbbp" event={"ID":"6f354a22-d010-4046-ad58-42edce5e8032","Type":"ContainerStarted","Data":"b3c7fd426e55db6561cdb1eefa56b68f6650bb99f7aefc3513f82cbf47c8373d"}
Jul 06 19:52:12.422597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.422567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8z2d" event={"ID":"1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3","Type":"ContainerStarted","Data":"8cc97ccef76ff3e534fda445df21fb8c6cb97927ee2ea3c1e1133ae9bcbbeba2"}
Jul 06 19:52:12.441880 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.441823    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz" podStartSLOduration=70.441800829 podStartE2EDuration="1m10.441800829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:12.440537601 +0000 UTC m=+71.824196362" watchObservedRunningTime="2026-07-06 19:52:12.441800829 +0000 UTC m=+71.825459581"
Jul 06 19:52:12.461956 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.461904    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b8z2d" podStartSLOduration=66.22562601 podStartE2EDuration="1m10.461875691s" totalImagesPullingTime="4.236249681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:12.460269645 +0000 UTC m=+71.843928413" watchObservedRunningTime="2026-07-06 19:52:12.461875691 +0000 UTC m=+71.845534441"
Jul 06 19:52:12.525678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.525650    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l97pz\""
Jul 06 19:52:12.534107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:12.534083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"
Jul 06 19:52:13.030125 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.030093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d5fdddbfc-xwvqf"]
Jul 06 19:52:13.033149 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:13.033120    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d488ca_2078_490c_bab3_34e4044b0c7a.slice/crio-dad7a06b4fb7c4c5895030e529f217c561651a3a6fef35cb0b73b3a3381836c3 WatchSource:0}: Error finding container dad7a06b4fb7c4c5895030e529f217c561651a3a6fef35cb0b73b3a3381836c3: Status 404 returned error can't find the container with id dad7a06b4fb7c4c5895030e529f217c561651a3a6fef35cb0b73b3a3381836c3
Jul 06 19:52:13.046958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.046928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk"]
Jul 06 19:52:13.251410 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.251385    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn"]
Jul 06 19:52:13.255703 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:13.255679    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118802f9_1420_4ad4_bc20_76d17dcb7871.slice/crio-c658cae32bfc7f9fa25853592e05a65964916644f151199366d255baf350c4b6 WatchSource:0}: Error finding container c658cae32bfc7f9fa25853592e05a65964916644f151199366d255baf350c4b6: Status 404 returned error can't find the container with id c658cae32bfc7f9fa25853592e05a65964916644f151199366d255baf350c4b6
Jul 06 19:52:13.427640 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.427607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zrbbp" event={"ID":"6f354a22-d010-4046-ad58-42edce5e8032","Type":"ContainerStarted","Data":"2e27eb5f3baa4aca4a08859abd46c8ecfa75f715c93593aeb0ad1326307dfde5"}
Jul 06 19:52:13.428741 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.428716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn" event={"ID":"118802f9-1420-4ad4-bc20-76d17dcb7871","Type":"ContainerStarted","Data":"c658cae32bfc7f9fa25853592e05a65964916644f151199366d255baf350c4b6"}
Jul 06 19:52:13.429990 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.429958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk" event={"ID":"7e351c67-a905-4aec-8dfd-9e09e09dcf7a","Type":"ContainerStarted","Data":"1cc7a3d9b0073c585c678d6b18af2c25f75d0779bc565c18abe19b23f06250e7"}
Jul 06 19:52:13.431504 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.431480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf" event={"ID":"14d488ca-2078-490c-bab3-34e4044b0c7a","Type":"ContainerStarted","Data":"9f82665ec07b073315c55c0fcbbb496f2053f2de16a5e454b5bddd31cadbcb09"}
Jul 06 19:52:13.431599 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.431518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf" event={"ID":"14d488ca-2078-490c-bab3-34e4044b0c7a","Type":"ContainerStarted","Data":"dad7a06b4fb7c4c5895030e529f217c561651a3a6fef35cb0b73b3a3381836c3"}
Jul 06 19:52:13.450868 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:13.450813    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf" podStartSLOduration=33.45079336 podStartE2EDuration="33.45079336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:13.450310182 +0000 UTC m=+72.833968933" watchObservedRunningTime="2026-07-06 19:52:13.45079336 +0000 UTC m=+72.834452113"
Jul 06 19:52:14.401856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:14.401817    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:14.404658 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:14.404634    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:14.440297 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:14.440249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zrbbp" event={"ID":"6f354a22-d010-4046-ad58-42edce5e8032","Type":"ContainerStarted","Data":"bea91707ef1587bc74292e21a1fcc26c1f1d1aef4c400b18b0c29a9f4f71459c"}
Jul 06 19:52:14.440565 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:14.440549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:14.441940 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:14.441918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d5fdddbfc-xwvqf"
Jul 06 19:52:14.461588 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:14.461526    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zrbbp" podStartSLOduration=34.635254871 podStartE2EDuration="36.461505458s" totalImagesPullingTime="1.826250587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:14.459956684 +0000 UTC m=+73.843615435" watchObservedRunningTime="2026-07-06 19:52:14.461505458 +0000 UTC m=+73.845164209"
Jul 06 19:52:15.167904 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:15.167857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.232768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:15.232707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.444209 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:15.444134    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:52:16.810572 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:16.810527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:16.917091 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:16.917003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:17.014855 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.014823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:17.358091 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.358061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:17.452334 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.452295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn" event={"ID":"118802f9-1420-4ad4-bc20-76d17dcb7871","Type":"ContainerStarted","Data":"536102daef8445f1ca39b32cdd8d5e669770a8d2c27317af06d1b604fb5985aa"}
Jul 06 19:52:17.453989 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.453964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk" event={"ID":"7e351c67-a905-4aec-8dfd-9e09e09dcf7a","Type":"ContainerStarted","Data":"e1ca886c443dd004d702313d5eacc83e1b8a8193cb734429e03de00bd8f4a2ab"}
Jul 06 19:52:17.454144 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.454010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk" event={"ID":"7e351c67-a905-4aec-8dfd-9e09e09dcf7a","Type":"ContainerStarted","Data":"6281dddc6d26babcd4442967c2f967c0419d15b7baf51889df0eb6178f43f88f"}
Jul 06 19:52:17.485195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.485141    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-zgbgn" podStartSLOduration=34.363524135 podStartE2EDuration="37.485124276s" totalImagesPullingTime="3.121600141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:17.483605668 +0000 UTC m=+76.867264417" watchObservedRunningTime="2026-07-06 19:52:17.485124276 +0000 UTC m=+76.868783025"
Jul 06 19:52:17.509115 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.509055    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fpzzk" podStartSLOduration=34.41904101 podStartE2EDuration="37.509037233s" totalImagesPullingTime="3.089996223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:17.508110351 +0000 UTC m=+76.891769101" watchObservedRunningTime="2026-07-06 19:52:17.509037233 +0000 UTC m=+76.892695981"
Jul 06 19:52:17.831221 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.831182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:17.992985 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:17.992901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:18.108383 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:18.108328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:18.208706 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:18.208667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:20.377762 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:20.377730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:20.442180 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:20.442136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:21.003957 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:21.003927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:21.091667 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:21.091630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:21.284773 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:21.284688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:23.028749 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.028714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:52:23.031270 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.031240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31805ed6-206c-4c30-9e5b-2793c0a2f62f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lrcz\" (UID: \"31805ed6-206c-4c30-9e5b-2793c0a2f62f\") " pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:52:23.260204 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.260175    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-72blj\""
Jul 06 19:52:23.268813 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.268791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lrcz"
Jul 06 19:52:23.407951 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.407918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lrcz"]
Jul 06 19:52:23.410923 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:23.410896    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31805ed6_206c_4c30_9e5b_2793c0a2f62f.slice/crio-936b9d173c5494d4a8b5873cfc64b5c36ccd45ec51ddbdd2180cca14a24f8581 WatchSource:0}: Error finding container 936b9d173c5494d4a8b5873cfc64b5c36ccd45ec51ddbdd2180cca14a24f8581: Status 404 returned error can't find the container with id 936b9d173c5494d4a8b5873cfc64b5c36ccd45ec51ddbdd2180cca14a24f8581
Jul 06 19:52:23.452261 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.452222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:23.475437 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.475394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lrcz" event={"ID":"31805ed6-206c-4c30-9e5b-2793c0a2f62f","Type":"ContainerStarted","Data":"936b9d173c5494d4a8b5873cfc64b5c36ccd45ec51ddbdd2180cca14a24f8581"}
Jul 06 19:52:23.537511 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:23.537408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:25.226624 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:25.226587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:25.406071 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:25.406021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:25.450773 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:25.450742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zrbbp"
Jul 06 19:52:25.477863 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:25.477696    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:25.565510 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:25.565474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:26.401970 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:26.401938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:26.502711 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:26.502669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:27.494872 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:27.494834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lrcz" event={"ID":"31805ed6-206c-4c30-9e5b-2793c0a2f62f","Type":"ContainerStarted","Data":"3ecbea856525c1df0fdd85e815150d3fe3563f5ef7d9ede1eeedbffad74a3011"}
Jul 06 19:52:28.206512 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.206477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:28.445017 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.444974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:28.477151 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.477118    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"]
Jul 06 19:52:28.480729 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.480704    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.483040 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.483000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:52:28.483780 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.483754    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kdn8x\""
Jul 06 19:52:28.483887 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.483786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:52:28.484226 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.484198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 19:52:28.501844 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.501804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lrcz" event={"ID":"31805ed6-206c-4c30-9e5b-2793c0a2f62f","Type":"ContainerStarted","Data":"c7da0544cd322700f0974ade6554ed638d32b56119e1f59bd7ef9216e1ba8c5c"}
Jul 06 19:52:28.504118 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.504096    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"]
Jul 06 19:52:28.543758 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.543723    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g5thn"]
Jul 06 19:52:28.549261 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.549213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.551637 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.551585    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:52:28.552034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.552013    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:52:28.555172 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.555150    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4dfxs\""
Jul 06 19:52:28.555332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.555310    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:52:28.567144 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.567117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:28.577121 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.577092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.577251 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.577130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpg2j\" (UniqueName: \"kubernetes.io/projected/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-kube-api-access-zpg2j\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.577251 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.577166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.577251 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.577213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.678344 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-tls\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.678344 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc5c436e-9806-45b2-bdfe-55077ea09a00-metrics-client-ca\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.678609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.678609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpg2j\" (UniqueName: \"kubernetes.io/projected/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-kube-api-access-zpg2j\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.678609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.678609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-textfile\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.678812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.678812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-wtmp\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.678812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.678812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-root\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.678812 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-accelerators-collector-config\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.679040 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-sys\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.679040 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.678865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbrm8\" (UniqueName: \"kubernetes.io/projected/fc5c436e-9806-45b2-bdfe-55077ea09a00-kube-api-access-jbrm8\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.679581 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.679552    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.681348 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.681322    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.681591 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.681565    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.697834 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.697728    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpg2j\" (UniqueName: \"kubernetes.io/projected/cffd6c27-1efe-47e3-86d1-c2d1b0a7b792-kube-api-access-zpg2j\") pod \"openshift-state-metrics-54cf96dfcf-v8wr9\" (UID: \"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.699324 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.699290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:28.779565 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc5c436e-9806-45b2-bdfe-55077ea09a00-metrics-client-ca\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.779754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-textfile\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.779754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-wtmp\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.779754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.779754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-root\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.779754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-accelerators-collector-config\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.779754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-sys\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780062 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbrm8\" (UniqueName: \"kubernetes.io/projected/fc5c436e-9806-45b2-bdfe-55077ea09a00-kube-api-access-jbrm8\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780062 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-tls\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780062 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.779842    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-wtmp\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780262 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.780146    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-root\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780262 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.780204    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc5c436e-9806-45b2-bdfe-55077ea09a00-sys\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780396 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.780278    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc5c436e-9806-45b2-bdfe-55077ea09a00-metrics-client-ca\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780396 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.780341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-accelerators-collector-config\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.780656 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.780634    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-textfile\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.782918 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.782889    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.783209 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.783189    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc5c436e-9806-45b2-bdfe-55077ea09a00-node-exporter-tls\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.789123 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.789100    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbrm8\" (UniqueName: \"kubernetes.io/projected/fc5c436e-9806-45b2-bdfe-55077ea09a00-kube-api-access-jbrm8\") pod \"node-exporter-g5thn\" (UID: \"fc5c436e-9806-45b2-bdfe-55077ea09a00\") " pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.791993 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.791969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"
Jul 06 19:52:28.798960 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.798923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:28.862521 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.862481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g5thn"
Jul 06 19:52:28.879458 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:28.879410    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5c436e_9806_45b2_bdfe_55077ea09a00.slice/crio-bef0eeabc084056c7ffe443dd9c6edd9924643466766e6f4f039a6b35ad3c5c2 WatchSource:0}: Error finding container bef0eeabc084056c7ffe443dd9c6edd9924643466766e6f4f039a6b35ad3c5c2: Status 404 returned error can't find the container with id bef0eeabc084056c7ffe443dd9c6edd9924643466766e6f4f039a6b35ad3c5c2
Jul 06 19:52:28.906184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.906131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:28.952785 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:28.952630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9"]
Jul 06 19:52:28.955545 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:28.955503    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffd6c27_1efe_47e3_86d1_c2d1b0a7b792.slice/crio-5bb397292d9fe73eeacf9a28793dffda0e838ae594b6de99a91e8c26c63b44c4 WatchSource:0}: Error finding container 5bb397292d9fe73eeacf9a28793dffda0e838ae594b6de99a91e8c26c63b44c4: Status 404 returned error can't find the container with id 5bb397292d9fe73eeacf9a28793dffda0e838ae594b6de99a91e8c26c63b44c4
Jul 06 19:52:29.000808 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.000751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:29.102409 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.102346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:29.385233 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.385197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:29.486243 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.486173    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:29.509441 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.509315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g5thn" event={"ID":"fc5c436e-9806-45b2-bdfe-55077ea09a00","Type":"ContainerStarted","Data":"bef0eeabc084056c7ffe443dd9c6edd9924643466766e6f4f039a6b35ad3c5c2"}
Jul 06 19:52:29.512336 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.512305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9" event={"ID":"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792","Type":"ContainerStarted","Data":"8bd5eed092cd7765a7938de998df73e31ae4e96ac6ed8b02eab43b63e1529b63"}
Jul 06 19:52:29.512487 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.512396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9" event={"ID":"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792","Type":"ContainerStarted","Data":"2e25a6e6a54e71049b98b9329d13c3f0cf0bc9d6a49c178b3050b4ffd0c601bc"}
Jul 06 19:52:29.512487 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.512427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9" event={"ID":"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792","Type":"ContainerStarted","Data":"5bb397292d9fe73eeacf9a28793dffda0e838ae594b6de99a91e8c26c63b44c4"}
Jul 06 19:52:29.597504 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.597472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:29.912475 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:29.912435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:30.548642 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.548607    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6989489c6f-mj2fr"]
Jul 06 19:52:30.564783 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.564752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.567303 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.567272    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 19:52:30.567672 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.567275    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 19:52:30.568561 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.568539    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-chhaj3g5oevh1\""
Jul 06 19:52:30.568662 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.568541    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 19:52:30.569790 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.569768    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 19:52:30.570026 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.570007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-87nk4\""
Jul 06 19:52:30.570731 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.570711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 19:52:30.571471 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.571442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6989489c6f-mj2fr"]
Jul 06 19:52:30.598891 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.598856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcx5s\" (UniqueName: \"kubernetes.io/projected/90db7674-94b5-4c1a-b93d-cc16a8ed3249-kube-api-access-jcx5s\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599071 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.598900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599071 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.598945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599071 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.598996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599071 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.599055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-tls\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599266 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.599109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599266 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.599153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90db7674-94b5-4c1a-b93d-cc16a8ed3249-metrics-client-ca\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.599266 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.599181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-grpc-tls\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700043 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-tls\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700240 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700240 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90db7674-94b5-4c1a-b93d-cc16a8ed3249-metrics-client-ca\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700240 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-grpc-tls\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700240 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcx5s\" (UniqueName: \"kubernetes.io/projected/90db7674-94b5-4c1a-b93d-cc16a8ed3249-kube-api-access-jcx5s\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700240 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700240 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.700468 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.700241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.701485 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.701454    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90db7674-94b5-4c1a-b93d-cc16a8ed3249-metrics-client-ca\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.703813 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.703785    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-tls\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.703968 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.703908    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.705511 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.705434    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.705828 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.705805    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-grpc-tls\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.706004 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.705979    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.709903 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.709870    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcx5s\" (UniqueName: \"kubernetes.io/projected/90db7674-94b5-4c1a-b93d-cc16a8ed3249-kube-api-access-jcx5s\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.714153 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.714089    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90db7674-94b5-4c1a-b93d-cc16a8ed3249-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6989489c6f-mj2fr\" (UID: \"90db7674-94b5-4c1a-b93d-cc16a8ed3249\") " pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:30.876134 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:30.876106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:31.047701 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.047670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6989489c6f-mj2fr"]
Jul 06 19:52:31.072317 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:31.072284    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90db7674_94b5_4c1a_b93d_cc16a8ed3249.slice/crio-7493b35bace17be332b5f64e46a9126e62275cb8889e56199ed21bb7ebeb1ead WatchSource:0}: Error finding container 7493b35bace17be332b5f64e46a9126e62275cb8889e56199ed21bb7ebeb1ead: Status 404 returned error can't find the container with id 7493b35bace17be332b5f64e46a9126e62275cb8889e56199ed21bb7ebeb1ead
Jul 06 19:52:31.484167 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.484131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:31.522231 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.522203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9" event={"ID":"cffd6c27-1efe-47e3-86d1-c2d1b0a7b792","Type":"ContainerStarted","Data":"a9cff09e307988cbe1b8c0bdaee1c7e5c27e0aea9250dc3215d73a2d189b9d4a"}
Jul 06 19:52:31.523392 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.523351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"7493b35bace17be332b5f64e46a9126e62275cb8889e56199ed21bb7ebeb1ead"}
Jul 06 19:52:31.525305 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.525278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lrcz" event={"ID":"31805ed6-206c-4c30-9e5b-2793c0a2f62f","Type":"ContainerStarted","Data":"9c4ce95ba031ee0bf95840ce427698b8b36400fecccb132834fef5f3bd574d5e"}
Jul 06 19:52:31.526960 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.526929    2581 generic.go:356] "Generic (PLEG): container finished" podID="fc5c436e-9806-45b2-bdfe-55077ea09a00" containerID="9cee1234b09dce964375671708fa6b57a278584529be412a0db95c0a8a899d65" exitCode=0
Jul 06 19:52:31.527099 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.526960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g5thn" event={"ID":"fc5c436e-9806-45b2-bdfe-55077ea09a00","Type":"ContainerDied","Data":"9cee1234b09dce964375671708fa6b57a278584529be412a0db95c0a8a899d65"}
Jul 06 19:52:31.547090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.547042    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-v8wr9" podStartSLOduration=1.211569385 podStartE2EDuration="3.547024973s" totalImagesPullingTime="2.335455588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:31.545501402 +0000 UTC m=+90.929160151" watchObservedRunningTime="2026-07-06 19:52:31.547024973 +0000 UTC m=+90.930683753"
Jul 06 19:52:31.575686 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.575616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:31.590736 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.590690    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5lrcz" podStartSLOduration=33.274613449 podStartE2EDuration="40.59067345s" totalImagesPullingTime="7.316060001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:51:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:31.589694207 +0000 UTC m=+90.973352957" watchObservedRunningTime="2026-07-06 19:52:31.59067345 +0000 UTC m=+90.974332249"
Jul 06 19:52:31.859300 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:31.859263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:32.275608 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:32.275573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:32.532975 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:32.532884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g5thn" event={"ID":"fc5c436e-9806-45b2-bdfe-55077ea09a00","Type":"ContainerStarted","Data":"c7e321f25d9cde833f4a1c590b234eef83673550e7cacfa731f86c7b6b071159"}
Jul 06 19:52:32.532975 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:32.532941    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g5thn" event={"ID":"fc5c436e-9806-45b2-bdfe-55077ea09a00","Type":"ContainerStarted","Data":"e2f51b8f35a328d8749c8bcaa3d984f078aa4d64f1b9a323a0176c7de400c1c8"}
Jul 06 19:52:32.552886 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:32.552827    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g5thn" podStartSLOduration=2.499735231 podStartE2EDuration="4.55280739s" totalImagesPullingTime="1.965396945s" totalInitContainerRuntime="87.675214ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:32.551226783 +0000 UTC m=+91.934885533" watchObservedRunningTime="2026-07-06 19:52:32.55280739 +0000 UTC m=+91.936466138"
Jul 06 19:52:33.209756 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.209721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:33.220105 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.220057    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"]
Jul 06 19:52:33.225834 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.225317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.228126 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.228099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:52:33.228273 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.228207    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-75lbq\""
Jul 06 19:52:33.231659 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.231631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"]
Jul 06 19:52:33.304865 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.304829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:33.320548 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.320511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-674qs\" (UniqueName: \"kubernetes.io/projected/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-kube-api-access-674qs\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.320548 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.320552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.421217 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.421185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-674qs\" (UniqueName: \"kubernetes.io/projected/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-kube-api-access-674qs\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.421346 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.421225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.421424 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:52:33.421354    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 19:52:33.421473 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:52:33.421429    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-monitoring-plugin-cert podName:5b747520-23f2-436e-9f0e-a6bec9f5b1fc nodeName:}" failed. No retries permitted until 2026-07-06 19:52:33.921408081 +0000 UTC m=+93.305066815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-cldkq" (UID: "5b747520-23f2-436e-9f0e-a6bec9f5b1fc") : secret "monitoring-plugin-cert" not found
Jul 06 19:52:33.429341 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.429309    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-674qs\" (UniqueName: \"kubernetes.io/projected/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-kube-api-access-674qs\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.438344 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.437566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:52:33.538651 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.538603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"f6f2cf14cc93563c466c0f9336e9187f19138a7ffd8e79d66e9fc7bbbea838a9"}
Jul 06 19:52:33.538800 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.538697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"28f48c6da41137380a6d8dea8c325239a7c6a3e2e80c78f516d7e0f95b9b85c3"}
Jul 06 19:52:33.607874 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.607835    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:33.710302 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.710264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:33.785820 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.785727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:33.924623 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.924575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:33.927201 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:33.927179    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b747520-23f2-436e-9f0e-a6bec9f5b1fc-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cldkq\" (UID: \"5b747520-23f2-436e-9f0e-a6bec9f5b1fc\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:34.137568 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:34.137535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:34.298960 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:34.298884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"]
Jul 06 19:52:34.301446 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:34.301419    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b747520_23f2_436e_9f0e_a6bec9f5b1fc.slice/crio-cde24f4e530719490605f629edcca94f45ff3db41bd58d8e38dfa0b7f5ff103e WatchSource:0}: Error finding container cde24f4e530719490605f629edcca94f45ff3db41bd58d8e38dfa0b7f5ff103e: Status 404 returned error can't find the container with id cde24f4e530719490605f629edcca94f45ff3db41bd58d8e38dfa0b7f5ff103e
Jul 06 19:52:34.544354 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:34.544325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq" event={"ID":"5b747520-23f2-436e-9f0e-a6bec9f5b1fc","Type":"ContainerStarted","Data":"cde24f4e530719490605f629edcca94f45ff3db41bd58d8e38dfa0b7f5ff103e"}
Jul 06 19:52:34.546607 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:34.546573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"0d9ac06dd6ac0407bea799ccbfb5729b32bf4c407cf2d0dcd2ef6b194edc9744"}
Jul 06 19:52:34.872687 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:34.872642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:35.553828 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:35.553788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"3a563af2d2e364b5fb4f1173a221df0d0e94eefc3b52049aaf04ed614fc86784"}
Jul 06 19:52:35.554296 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:35.553880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"489a03009931ba43e0c8b6758243dd62d7734756ff5ee2bced2e0dde6ac0fd57"}
Jul 06 19:52:35.554296 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:35.553912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" event={"ID":"90db7674-94b5-4c1a-b93d-cc16a8ed3249","Type":"ContainerStarted","Data":"37b4316eea24e9f06650f81cd356b7f8c6c99ea6a8aee2eb721328a8d9b50bb2"}
Jul 06 19:52:35.554296 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:35.553942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:35.577078 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:35.577009    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr" podStartSLOduration=2.356665891 podStartE2EDuration="5.576984708s" totalImagesPullingTime="3.220318817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:35.574438578 +0000 UTC m=+94.958097357" watchObservedRunningTime="2026-07-06 19:52:35.576984708 +0000 UTC m=+94.960643462"
Jul 06 19:52:36.014785 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.014747    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-647c474c6f-qqpfp"]
Jul 06 19:52:36.023522 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.023484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.025970 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.025941    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:52:36.025970 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.025963    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:52:36.026164 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.025971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zs2b6\""
Jul 06 19:52:36.026164 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.025941    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:52:36.026305 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.026292    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:52:36.026496 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.026461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:52:36.026640 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.026500    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:52:36.026640 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.026578    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:52:36.032329 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.032300    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647c474c6f-qqpfp"]
Jul 06 19:52:36.033505 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.033486    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:52:36.040657 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-serving-cert\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.040657 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-oauth-serving-cert\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.040840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-config\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.040840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwrh\" (UniqueName: \"kubernetes.io/projected/d4ef253c-69d4-42af-907e-c9263fe2f54e-kube-api-access-xfwrh\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.040840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-service-ca\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.040840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-oauth-config\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.040840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.040779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-trusted-ca-bundle\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.141909 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-serving-cert\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.141909 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-oauth-serving-cert\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.141909 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-config\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.141909 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwrh\" (UniqueName: \"kubernetes.io/projected/d4ef253c-69d4-42af-907e-c9263fe2f54e-kube-api-access-xfwrh\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142227 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-service-ca\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142227 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-oauth-config\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142227 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.141977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-trusted-ca-bundle\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142732 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.142702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-oauth-serving-cert\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142926 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.142805    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-config\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142926 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.142880    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-service-ca\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.142926 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.142889    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-trusted-ca-bundle\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.144595 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.144576    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-serving-cert\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.144669 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.144614    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-oauth-config\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.150336 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.150308    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwrh\" (UniqueName: \"kubernetes.io/projected/d4ef253c-69d4-42af-907e-c9263fe2f54e-kube-api-access-xfwrh\") pod \"console-647c474c6f-qqpfp\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") " pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.335575 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.335537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:36.476713 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.476687    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647c474c6f-qqpfp"]
Jul 06 19:52:36.479303 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:36.479276    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ef253c_69d4_42af_907e_c9263fe2f54e.slice/crio-93d42b2ef071f1b4708f12fa0ee13ff010ed0cdf938bb3ed1e8955323f24dad2 WatchSource:0}: Error finding container 93d42b2ef071f1b4708f12fa0ee13ff010ed0cdf938bb3ed1e8955323f24dad2: Status 404 returned error can't find the container with id 93d42b2ef071f1b4708f12fa0ee13ff010ed0cdf938bb3ed1e8955323f24dad2
Jul 06 19:52:36.559144 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.559091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq" event={"ID":"5b747520-23f2-436e-9f0e-a6bec9f5b1fc","Type":"ContainerStarted","Data":"caa366c21c1e00905e65ca3471ffac9fc7f6b980a8eaed6399464fb73a0d816d"}
Jul 06 19:52:36.559606 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.559159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:36.560393 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.560344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647c474c6f-qqpfp" event={"ID":"d4ef253c-69d4-42af-907e-c9263fe2f54e","Type":"ContainerStarted","Data":"93d42b2ef071f1b4708f12fa0ee13ff010ed0cdf938bb3ed1e8955323f24dad2"}
Jul 06 19:52:36.564640 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.564617    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq"
Jul 06 19:52:36.597169 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:36.597117    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cldkq" podStartSLOduration=2.021913375 podStartE2EDuration="3.597099095s" totalImagesPullingTime="1.57518572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:36.57878447 +0000 UTC m=+95.962443231" watchObservedRunningTime="2026-07-06 19:52:36.597099095 +0000 UTC m=+95.980757877"
Jul 06 19:52:37.835439 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:37.835399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:37.902287 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:37.902227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:38.410348 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:38.410174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:38.512325 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:38.512270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:39.011402 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:39.011327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:39.072424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:39.072343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:39.409712 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:39.409682    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rxg5m"
Jul 06 19:52:39.576966 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:39.576930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647c474c6f-qqpfp" event={"ID":"d4ef253c-69d4-42af-907e-c9263fe2f54e","Type":"ContainerStarted","Data":"486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823"}
Jul 06 19:52:39.854925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:39.854878    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:39.956718 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:39.956661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:40.280077 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:40.279983    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b44b8988c-qzbzz"]
Jul 06 19:52:40.366145 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:40.366108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:40.445331 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:40.445295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:40.507285 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:40.507249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:40.599019 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:40.598963    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-647c474c6f-qqpfp" podStartSLOduration=2.586119515 podStartE2EDuration="5.598945558s" totalImagesPullingTime="3.012826043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:40.598812487 +0000 UTC m=+99.982471227" watchObservedRunningTime="2026-07-06 19:52:40.598945558 +0000 UTC m=+99.982604306"
Jul 06 19:52:41.567356 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:41.567327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6989489c6f-mj2fr"
Jul 06 19:52:44.175223 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:44.175188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:44.275687 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:44.275646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:45.174637 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:45.174599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:45.275296 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:45.275259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:46.311538 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.311498    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647c474c6f-qqpfp"]
Jul 06 19:52:46.335987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.335947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:52:46.351889 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.351847    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8666997998-tl9dn"]
Jul 06 19:52:46.357003 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.356976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.369332 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.369302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666997998-tl9dn"]
Jul 06 19:52:46.437192 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-config\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.437424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-oauth-serving-cert\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.437424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7pr7\" (UniqueName: \"kubernetes.io/projected/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-kube-api-access-j7pr7\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.437424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-serving-cert\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.437424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-service-ca\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.437628 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-trusted-ca-bundle\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.437628 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.437518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-oauth-config\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.538945 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.538904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-trusted-ca-bundle\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.538945 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.538945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-oauth-config\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.539184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.538965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-config\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.539184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.538991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-oauth-serving-cert\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.539184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.539024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7pr7\" (UniqueName: \"kubernetes.io/projected/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-kube-api-access-j7pr7\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.539184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.539042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-serving-cert\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.539184 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.539083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-service-ca\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.540207 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.539923    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-config\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.540428 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.540389    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-service-ca\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.540764 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.540622    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-trusted-ca-bundle\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.541103 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.541077    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-oauth-serving-cert\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.545958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.545709    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-serving-cert\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.545958 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.545767    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-oauth-config\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.551646 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.551606    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7pr7\" (UniqueName: \"kubernetes.io/projected/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-kube-api-access-j7pr7\") pod \"console-8666997998-tl9dn\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") " pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.667702 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.667609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:46.853387 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:46.832897    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666997998-tl9dn"]
Jul 06 19:52:46.858103 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:52:46.858061    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb9699c_86a1_49aa_a9e0_45eb44e7faf6.slice/crio-58dbe6307ae2f4ae1267ffd23a6d60a59137b641c85c43872443da8ad43dd17b WatchSource:0}: Error finding container 58dbe6307ae2f4ae1267ffd23a6d60a59137b641c85c43872443da8ad43dd17b: Status 404 returned error can't find the container with id 58dbe6307ae2f4ae1267ffd23a6d60a59137b641c85c43872443da8ad43dd17b
Jul 06 19:52:47.610375 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:47.610328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666997998-tl9dn" event={"ID":"adb9699c-86a1-49aa-a9e0-45eb44e7faf6","Type":"ContainerStarted","Data":"82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12"}
Jul 06 19:52:47.610761 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:47.610400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666997998-tl9dn" event={"ID":"adb9699c-86a1-49aa-a9e0-45eb44e7faf6","Type":"ContainerStarted","Data":"58dbe6307ae2f4ae1267ffd23a6d60a59137b641c85c43872443da8ad43dd17b"}
Jul 06 19:52:47.641037 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:47.640980    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8666997998-tl9dn" podStartSLOduration=1.6409620999999999 podStartE2EDuration="1.6409621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:47.640199854 +0000 UTC m=+107.023858602" watchObservedRunningTime="2026-07-06 19:52:47.6409621 +0000 UTC m=+107.024620848"
Jul 06 19:52:48.984531 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:48.984496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:49.053191 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:49.053153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:54.347900 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:54.347858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:54.484459 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:54.484421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:54.552941 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:54.552906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:56.668278 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:56.668241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:56.669014 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:56.668318    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:56.674446 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:56.674422    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:57.655038 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:57.655005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:52:57.833791 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:57.833753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:57.933931 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:57.933847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:58.000979 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:52:58.000940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:00.175670 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:00.175627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:00.260205 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:00.260177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:04.956694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:04.956648    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:05.300969 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:05.300930    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz" podUID="e7660ad3-3a21-4481-be80-f3101f61c134" containerName="registry" containerID="cri-o://c3f3e1f3b2b02ce13e10fee3003ba3457330859d9fcc0ef0bab99eda540377a4" gracePeriod=30
Jul 06 19:53:05.683752 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:05.683662    2581 generic.go:356] "Generic (PLEG): container finished" podID="e7660ad3-3a21-4481-be80-f3101f61c134" containerID="c3f3e1f3b2b02ce13e10fee3003ba3457330859d9fcc0ef0bab99eda540377a4" exitCode=0
Jul 06 19:53:05.683752 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:05.683735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz" event={"ID":"e7660ad3-3a21-4481-be80-f3101f61c134","Type":"ContainerDied","Data":"c3f3e1f3b2b02ce13e10fee3003ba3457330859d9fcc0ef0bab99eda540377a4"}
Jul 06 19:53:06.072600 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.072570    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:53:06.216028 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.215984    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-trusted-ca\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216043    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h698f\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-kube-api-access-h698f\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-registry-certificates\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7660ad3-3a21-4481-be80-f3101f61c134-ca-trust-extracted\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216140    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-bound-sa-token\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216238    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-installation-pull-secrets\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-image-registry-private-configuration\") pod \"e7660ad3-3a21-4481-be80-f3101f61c134\" (UID: \"e7660ad3-3a21-4481-be80-f3101f61c134\") "
Jul 06 19:53:06.216596 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216569    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:06.216652 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216601    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:06.216709 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216683    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-trusted-ca\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.216709 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.216701    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7660ad3-3a21-4481-be80-f3101f61c134-registry-certificates\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.219189 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.219119    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:53:06.219189 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.219124    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-kube-api-access-h698f" (OuterVolumeSpecName: "kube-api-access-h698f") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "kube-api-access-h698f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:53:06.219189 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.219160    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:53:06.219438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.219320    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:53:06.219438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.219342    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:53:06.224634 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.224608    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7660ad3-3a21-4481-be80-f3101f61c134-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7660ad3-3a21-4481-be80-f3101f61c134" (UID: "e7660ad3-3a21-4481-be80-f3101f61c134"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:53:06.317988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.317949    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7660ad3-3a21-4481-be80-f3101f61c134-ca-trust-extracted\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.317988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.317981    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-bound-sa-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.317988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.317991    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-registry-tls\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.318287 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.317999    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-installation-pull-secrets\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.318287 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.318010    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7660ad3-3a21-4481-be80-f3101f61c134-image-registry-private-configuration\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.318287 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.318019    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h698f\" (UniqueName: \"kubernetes.io/projected/e7660ad3-3a21-4481-be80-f3101f61c134-kube-api-access-h698f\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:06.694052 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.693956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz" event={"ID":"e7660ad3-3a21-4481-be80-f3101f61c134","Type":"ContainerDied","Data":"da042662100fbfe609db312b327998bd7349535b212318f10def7751c5211f7d"}
Jul 06 19:53:06.694052 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.693992    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b44b8988c-qzbzz"
Jul 06 19:53:06.694052 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.694043    2581 scope.go:117] "RemoveContainer" containerID="c3f3e1f3b2b02ce13e10fee3003ba3457330859d9fcc0ef0bab99eda540377a4"
Jul 06 19:53:06.716118 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.716076    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b44b8988c-qzbzz"]
Jul 06 19:53:06.720013 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:06.719979    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b44b8988c-qzbzz"]
Jul 06 19:53:07.022786 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:07.022706    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7660ad3-3a21-4481-be80-f3101f61c134" path="/var/lib/kubelet/pods/e7660ad3-3a21-4481-be80-f3101f61c134/volumes"
Jul 06 19:53:09.708930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:09.708838    2581 generic.go:356] "Generic (PLEG): container finished" podID="79d39e8d-7fd5-4c0e-9259-559e644c186c" containerID="495cb7902c6503bad6f3c809a3fe403f24ca0ed50015217ce193034a700e14ee" exitCode=0
Jul 06 19:53:09.708930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:09.708908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb" event={"ID":"79d39e8d-7fd5-4c0e-9259-559e644c186c","Type":"ContainerDied","Data":"495cb7902c6503bad6f3c809a3fe403f24ca0ed50015217ce193034a700e14ee"}
Jul 06 19:53:09.709402 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:09.709236    2581 scope.go:117] "RemoveContainer" containerID="495cb7902c6503bad6f3c809a3fe403f24ca0ed50015217ce193034a700e14ee"
Jul 06 19:53:10.714948 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:10.714911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r5dtb" event={"ID":"79d39e8d-7fd5-4c0e-9259-559e644c186c","Type":"ContainerStarted","Data":"b7667e4613413cb7260cf0e2dd641a4e1652d9df1de1104f8d62d2c820a628be"}
Jul 06 19:53:10.716542 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:10.716516    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab56dc7-8d91-4c39-a7fd-19209a255b8c" containerID="e1b18296f818bb1e1614ef6ae4b7191ec2439628237f937112d694695c58d0d3" exitCode=0
Jul 06 19:53:10.716663 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:10.716570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc" event={"ID":"8ab56dc7-8d91-4c39-a7fd-19209a255b8c","Type":"ContainerDied","Data":"e1b18296f818bb1e1614ef6ae4b7191ec2439628237f937112d694695c58d0d3"}
Jul 06 19:53:10.716823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:10.716811    2581 scope.go:117] "RemoveContainer" containerID="e1b18296f818bb1e1614ef6ae4b7191ec2439628237f937112d694695c58d0d3"
Jul 06 19:53:11.333462 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.333404    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-647c474c6f-qqpfp" podUID="d4ef253c-69d4-42af-907e-c9263fe2f54e" containerName="console" containerID="cri-o://486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823" gracePeriod=15
Jul 06 19:53:11.594119 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.594051    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:53:11.722598 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.722558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-txtsc" event={"ID":"8ab56dc7-8d91-4c39-a7fd-19209a255b8c","Type":"ContainerStarted","Data":"92fec56c5100cba4c906790deb979a0f6abd9f08d3f54fa67c50a4ebb809d584"}
Jul 06 19:53:11.723799 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.723770    2581 generic.go:356] "Generic (PLEG): container finished" podID="d4ef253c-69d4-42af-907e-c9263fe2f54e" containerID="486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823" exitCode=0
Jul 06 19:53:11.723930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.723805    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647c474c6f-qqpfp"
Jul 06 19:53:11.723930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.723816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647c474c6f-qqpfp" event={"ID":"d4ef253c-69d4-42af-907e-c9263fe2f54e","Type":"ContainerDied","Data":"486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823"}
Jul 06 19:53:11.723930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.723860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647c474c6f-qqpfp" event={"ID":"d4ef253c-69d4-42af-907e-c9263fe2f54e","Type":"ContainerDied","Data":"93d42b2ef071f1b4708f12fa0ee13ff010ed0cdf938bb3ed1e8955323f24dad2"}
Jul 06 19:53:11.723930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.723890    2581 scope.go:117] "RemoveContainer" containerID="486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823"
Jul 06 19:53:11.732102 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.732084    2581 scope.go:117] "RemoveContainer" containerID="486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823"
Jul 06 19:53:11.732458 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:53:11.732437    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823\": container with ID starting with 486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823 not found: ID does not exist" containerID="486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823"
Jul 06 19:53:11.732501 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.732470    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823"} err="failed to get container status \"486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823\": rpc error: code = NotFound desc = could not find container \"486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823\": container with ID starting with 486ec0e62814853d319d40973c77557a4a864691387559e546fe1f631e04d823 not found: ID does not exist"
Jul 06 19:53:11.771211 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-service-ca\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771422 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771246    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-trusted-ca-bundle\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771422 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771283    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-serving-cert\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771422 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfwrh\" (UniqueName: \"kubernetes.io/projected/d4ef253c-69d4-42af-907e-c9263fe2f54e-kube-api-access-xfwrh\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771599 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-config\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771599 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-oauth-config\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771599 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-oauth-serving-cert\") pod \"d4ef253c-69d4-42af-907e-c9263fe2f54e\" (UID: \"d4ef253c-69d4-42af-907e-c9263fe2f54e\") "
Jul 06 19:53:11.771739 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771647    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:11.771739 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771683    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:11.771821 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771800    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-trusted-ca-bundle\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:11.771865 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.771819    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-service-ca\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:11.772173 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.772146    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:11.772380 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.772341    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-config" (OuterVolumeSpecName: "console-config") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:53:11.773859 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.773832    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ef253c-69d4-42af-907e-c9263fe2f54e-kube-api-access-xfwrh" (OuterVolumeSpecName: "kube-api-access-xfwrh") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "kube-api-access-xfwrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:53:11.773945 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.773884    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:53:11.773993 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.773971    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4ef253c-69d4-42af-907e-c9263fe2f54e" (UID: "d4ef253c-69d4-42af-907e-c9263fe2f54e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:53:11.872846 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.872751    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-serving-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:11.872846 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.872782    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfwrh\" (UniqueName: \"kubernetes.io/projected/d4ef253c-69d4-42af-907e-c9263fe2f54e-kube-api-access-xfwrh\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:11.872846 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.872793    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-config\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:11.872846 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.872802    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ef253c-69d4-42af-907e-c9263fe2f54e-console-oauth-config\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:11.872846 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:11.872811    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ef253c-69d4-42af-907e-c9263fe2f54e-oauth-serving-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:53:12.044633 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:12.044599    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647c474c6f-qqpfp"]
Jul 06 19:53:12.048056 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:12.048027    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-647c474c6f-qqpfp"]
Jul 06 19:53:13.022988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:13.022940    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ef253c-69d4-42af-907e-c9263fe2f54e" path="/var/lib/kubelet/pods/d4ef253c-69d4-42af-907e-c9263fe2f54e/volumes"
Jul 06 19:53:14.737310 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:14.737277    2581 generic.go:356] "Generic (PLEG): container finished" podID="812c743f-98d3-42a9-8ba6-08b7ec614f6f" containerID="413a83b6443ac71f4d06cdaf35603e237b26729161a5e28b1f96337f28a7ec3f" exitCode=0
Jul 06 19:53:14.737716 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:14.737339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq" event={"ID":"812c743f-98d3-42a9-8ba6-08b7ec614f6f","Type":"ContainerDied","Data":"413a83b6443ac71f4d06cdaf35603e237b26729161a5e28b1f96337f28a7ec3f"}
Jul 06 19:53:14.737716 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:14.737646    2581 scope.go:117] "RemoveContainer" containerID="413a83b6443ac71f4d06cdaf35603e237b26729161a5e28b1f96337f28a7ec3f"
Jul 06 19:53:15.174317 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:15.174271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:15.274823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:15.274771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:15.743590 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:15.743556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nmtkq" event={"ID":"812c743f-98d3-42a9-8ba6-08b7ec614f6f","Type":"ContainerStarted","Data":"704c6d6ab31d61a2cefc12e3467b8686e07b183017a2cf3c3e4eb2a8e20fec0c"}
Jul 06 19:53:44.669048 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:44.669010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:44.775268 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:44.775229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:56.703172 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:56.703076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:56.784308 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:53:56.784277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:00.166446 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.166408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:00.259723 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.259689    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d54484f59-2w878"]
Jul 06 19:54:00.260408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.260381    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7660ad3-3a21-4481-be80-f3101f61c134" containerName="registry"
Jul 06 19:54:00.260408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.260407    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7660ad3-3a21-4481-be80-f3101f61c134" containerName="registry"
Jul 06 19:54:00.260615 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.260429    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ef253c-69d4-42af-907e-c9263fe2f54e" containerName="console"
Jul 06 19:54:00.260615 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.260438    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ef253c-69d4-42af-907e-c9263fe2f54e" containerName="console"
Jul 06 19:54:00.260615 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.260519    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ef253c-69d4-42af-907e-c9263fe2f54e" containerName="console"
Jul 06 19:54:00.260615 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.260534    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7660ad3-3a21-4481-be80-f3101f61c134" containerName="registry"
Jul 06 19:54:00.261107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.261073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:00.263880 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.263862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.278622 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.278593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d54484f59-2w878"]
Jul 06 19:54:00.333277 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.333239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:00.372590 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-serving-cert\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.372760 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-oauth-serving-cert\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.372760 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-service-ca\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.372760 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-trusted-ca-bundle\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.372864 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-oauth-config\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.372864 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jm78\" (UniqueName: \"kubernetes.io/projected/00937ce4-fd4f-45d1-b2bd-d14d7187c241-kube-api-access-4jm78\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.372864 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.372830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-config\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.453710 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.453624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:00.474090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jm78\" (UniqueName: \"kubernetes.io/projected/00937ce4-fd4f-45d1-b2bd-d14d7187c241-kube-api-access-4jm78\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474090 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-config\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474309 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-serving-cert\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474309 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-oauth-serving-cert\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474309 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-service-ca\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474309 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-trusted-ca-bundle\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474309 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-oauth-config\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.474937 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-service-ca\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.475044 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474941    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-config\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.475044 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.474941    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-oauth-serving-cert\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.475441 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.475420    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-trusted-ca-bundle\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.476700 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.476681    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-serving-cert\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.476781 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.476771    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-oauth-config\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.484845 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.484822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jm78\" (UniqueName: \"kubernetes.io/projected/00937ce4-fd4f-45d1-b2bd-d14d7187c241-kube-api-access-4jm78\") pod \"console-5d54484f59-2w878\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") " pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.554339 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.554286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:00.573925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.573891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:00.751039 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.750965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d54484f59-2w878"]
Jul 06 19:54:00.754466 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:54:00.754440    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00937ce4_fd4f_45d1_b2bd_d14d7187c241.slice/crio-c17d4ab4830220229398c5fe6d38efb743762fb94340bdba80001505701e1af7 WatchSource:0}: Error finding container c17d4ab4830220229398c5fe6d38efb743762fb94340bdba80001505701e1af7: Status 404 returned error can't find the container with id c17d4ab4830220229398c5fe6d38efb743762fb94340bdba80001505701e1af7
Jul 06 19:54:00.924658 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.924627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d54484f59-2w878" event={"ID":"00937ce4-fd4f-45d1-b2bd-d14d7187c241","Type":"ContainerStarted","Data":"e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5"}
Jul 06 19:54:00.924826 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.924676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d54484f59-2w878" event={"ID":"00937ce4-fd4f-45d1-b2bd-d14d7187c241","Type":"ContainerStarted","Data":"c17d4ab4830220229398c5fe6d38efb743762fb94340bdba80001505701e1af7"}
Jul 06 19:54:00.971373 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:00.971318    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d54484f59-2w878" podStartSLOduration=0.971301714 podStartE2EDuration="971.301714ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:00.963465455 +0000 UTC m=+180.347124215" watchObservedRunningTime="2026-07-06 19:54:00.971301714 +0000 UTC m=+180.354960462"
Jul 06 19:54:01.060603 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:01.060563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:01.127069 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:01.127032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:10.575101 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:10.575060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:10.575588 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:10.575134    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:10.580009 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:10.579982    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:10.967674 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:10.967598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 19:54:11.046154 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:11.046117    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666997998-tl9dn"]
Jul 06 19:54:11.293567 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:11.293473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:11.602664 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:11.602634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:18.347912 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:18.347871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:18.495807 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:18.495763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:30.700042 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:30.699998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:30.825261 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:30.825227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:35.618635 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:35.618596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:36.993494 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:36.993449    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8666997998-tl9dn" podUID="adb9699c-86a1-49aa-a9e0-45eb44e7faf6" containerName="console" containerID="cri-o://82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12" gracePeriod=15
Jul 06 19:54:37.233357 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.233330    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:54:37.299495 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299465    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-service-ca\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.299648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7pr7\" (UniqueName: \"kubernetes.io/projected/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-kube-api-access-j7pr7\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.299648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299530    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-oauth-config\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.299648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-trusted-ca-bundle\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.299648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-config\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.299648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299611    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-oauth-serving-cert\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.299648 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.299626    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-serving-cert\") pod \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\" (UID: \"adb9699c-86a1-49aa-a9e0-45eb44e7faf6\") "
Jul 06 19:54:37.300078 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.300046    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-service-ca" (OuterVolumeSpecName: "service-ca") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:37.300192 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.300047    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:37.300192 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.300120    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:37.300192 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.300147    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-config" (OuterVolumeSpecName: "console-config") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:37.301814 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.301781    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-kube-api-access-j7pr7" (OuterVolumeSpecName: "kube-api-access-j7pr7") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "kube-api-access-j7pr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:37.301968 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.301947    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:54:37.302032 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.302014    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adb9699c-86a1-49aa-a9e0-45eb44e7faf6" (UID: "adb9699c-86a1-49aa-a9e0-45eb44e7faf6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:54:37.400609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400566    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-service-ca\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:37.400609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400604    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7pr7\" (UniqueName: \"kubernetes.io/projected/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-kube-api-access-j7pr7\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:37.400609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400615    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-oauth-config\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:37.400609 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400624    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-trusted-ca-bundle\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:37.400916 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400633    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-config\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:37.400916 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400641    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-oauth-serving-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:37.400916 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:37.400649    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb9699c-86a1-49aa-a9e0-45eb44e7faf6-console-serving-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:54:38.080273 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.080232    2581 generic.go:356] "Generic (PLEG): container finished" podID="adb9699c-86a1-49aa-a9e0-45eb44e7faf6" containerID="82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12" exitCode=0
Jul 06 19:54:38.080678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.080281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666997998-tl9dn" event={"ID":"adb9699c-86a1-49aa-a9e0-45eb44e7faf6","Type":"ContainerDied","Data":"82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12"}
Jul 06 19:54:38.080678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.080292    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666997998-tl9dn"
Jul 06 19:54:38.080678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.080331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666997998-tl9dn" event={"ID":"adb9699c-86a1-49aa-a9e0-45eb44e7faf6","Type":"ContainerDied","Data":"58dbe6307ae2f4ae1267ffd23a6d60a59137b641c85c43872443da8ad43dd17b"}
Jul 06 19:54:38.080678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.080358    2581 scope.go:117] "RemoveContainer" containerID="82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12"
Jul 06 19:54:38.089685 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.089662    2581 scope.go:117] "RemoveContainer" containerID="82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12"
Jul 06 19:54:38.090014 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:54:38.089995    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12\": container with ID starting with 82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12 not found: ID does not exist" containerID="82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12"
Jul 06 19:54:38.090070 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.090023    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12"} err="failed to get container status \"82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12\": rpc error: code = NotFound desc = could not find container \"82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12\": container with ID starting with 82516dc1fbd0df3fecc92fdf97cefc2976a0691251330661f2d0d5b6db198a12 not found: ID does not exist"
Jul 06 19:54:38.403689 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.403605    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666997998-tl9dn"]
Jul 06 19:54:38.407125 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:38.407099    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8666997998-tl9dn"]
Jul 06 19:54:39.022180 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:39.022146    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adb9699c-86a1-49aa-a9e0-45eb44e7faf6" path="/var/lib/kubelet/pods/adb9699c-86a1-49aa-a9e0-45eb44e7faf6/volumes"
Jul 06 19:54:40.384423 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:40.384383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:40.448348 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:40.448304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.378511 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:57.378472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:58.365930 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:58.365895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:59.659580 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.659549    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"]
Jul 06 19:54:59.659971 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.659866    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb9699c-86a1-49aa-a9e0-45eb44e7faf6" containerName="console"
Jul 06 19:54:59.659971 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.659876    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb9699c-86a1-49aa-a9e0-45eb44e7faf6" containerName="console"
Jul 06 19:54:59.659971 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.659944    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb9699c-86a1-49aa-a9e0-45eb44e7faf6" containerName="console"
Jul 06 19:54:59.662840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.662822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.665161 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.665141    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 19:54:59.665263 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.665145    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5ggjr\""
Jul 06 19:54:59.665684 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.665669    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:54:59.686839 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.686805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"]
Jul 06 19:54:59.799686 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.799649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrlgf\" (UID: \"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.799883 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.799718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74cpg\" (UniqueName: \"kubernetes.io/projected/5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0-kube-api-access-74cpg\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrlgf\" (UID: \"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.900277 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.900232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74cpg\" (UniqueName: \"kubernetes.io/projected/5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0-kube-api-access-74cpg\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrlgf\" (UID: \"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.900489 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.900288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrlgf\" (UID: \"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.900649 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.900632    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrlgf\" (UID: \"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.910014 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.909935    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74cpg\" (UniqueName: \"kubernetes.io/projected/5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0-kube-api-access-74cpg\") pod \"cert-manager-operator-controller-manager-55c444bf86-zrlgf\" (UID: \"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:54:59.971913 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:54:59.971855    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"
Jul 06 19:55:00.117988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:00.117902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf"]
Jul 06 19:55:00.120375 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:55:00.120327    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d52ce8f_a6bc_413b_8dfb_6f8d1cd45de0.slice/crio-31ff84c150ae0778c195dabb6242dc51d7f648d938e5a421b6101757827b62ac WatchSource:0}: Error finding container 31ff84c150ae0778c195dabb6242dc51d7f648d938e5a421b6101757827b62ac: Status 404 returned error can't find the container with id 31ff84c150ae0778c195dabb6242dc51d7f648d938e5a421b6101757827b62ac
Jul 06 19:55:00.176056 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:00.175960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf" event={"ID":"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0","Type":"ContainerStarted","Data":"31ff84c150ae0778c195dabb6242dc51d7f648d938e5a421b6101757827b62ac"}
Jul 06 19:55:01.200727 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:01.200628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:01.302314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:01.302276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.192345 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:03.192307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf" event={"ID":"5d52ce8f-a6bc-413b-8dfb-6f8d1cd45de0","Type":"ContainerStarted","Data":"37ed0e3ecc6a6f7afcee73617d842eb7f508fc3a14ca9d724168d24573b1a5e9"}
Jul 06 19:55:03.222548 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:03.222487    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zrlgf" podStartSLOduration=1.6621039290000001 podStartE2EDuration="4.22246574s" totalImagesPullingTime="2.560361811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:03.221442772 +0000 UTC m=+242.605101522" watchObservedRunningTime="2026-07-06 19:55:03.22246574 +0000 UTC m=+242.606124490"
Jul 06 19:55:03.704472 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:03.704427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.931626 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:03.931591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.167491 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.167449    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7qd9t"]
Jul 06 19:55:04.170972 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.170946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.177757 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.177404    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:55:04.182191 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.182165    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:55:04.202236 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.202196    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7qd9t"]
Jul 06 19:55:04.339148 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.339103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twzf\" (UniqueName: \"kubernetes.io/projected/1ec456c8-c4e6-4d57-a574-1daff8ff4c0a-kube-api-access-2twzf\") pod \"cert-manager-webhook-6486ffd997-7qd9t\" (UID: \"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.339416 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.339162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ec456c8-c4e6-4d57-a574-1daff8ff4c0a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7qd9t\" (UID: \"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.440586 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.440479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2twzf\" (UniqueName: \"kubernetes.io/projected/1ec456c8-c4e6-4d57-a574-1daff8ff4c0a-kube-api-access-2twzf\") pod \"cert-manager-webhook-6486ffd997-7qd9t\" (UID: \"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.440586 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.440557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ec456c8-c4e6-4d57-a574-1daff8ff4c0a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7qd9t\" (UID: \"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.466674 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.466643    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twzf\" (UniqueName: \"kubernetes.io/projected/1ec456c8-c4e6-4d57-a574-1daff8ff4c0a-kube-api-access-2twzf\") pod \"cert-manager-webhook-6486ffd997-7qd9t\" (UID: \"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.468516 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.468489    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ec456c8-c4e6-4d57-a574-1daff8ff4c0a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7qd9t\" (UID: \"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.491469 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.491429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:04.691898 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:55:04.691819    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ec456c8_c4e6_4d57_a574_1daff8ff4c0a.slice/crio-48604cd60ab69018c9f9c3c72af8a7b595994dd38d71821d8697e73e10e7f90b WatchSource:0}: Error finding container 48604cd60ab69018c9f9c3c72af8a7b595994dd38d71821d8697e73e10e7f90b: Status 404 returned error can't find the container with id 48604cd60ab69018c9f9c3c72af8a7b595994dd38d71821d8697e73e10e7f90b
Jul 06 19:55:04.696008 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:04.695982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7qd9t"]
Jul 06 19:55:05.205906 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:05.205871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t" event={"ID":"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a","Type":"ContainerStarted","Data":"48604cd60ab69018c9f9c3c72af8a7b595994dd38d71821d8697e73e10e7f90b"}
Jul 06 19:55:05.841635 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:05.841603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:06.267322 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:06.267170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:08.221293 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:08.221253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t" event={"ID":"1ec456c8-c4e6-4d57-a574-1daff8ff4c0a","Type":"ContainerStarted","Data":"95f36e97632165d1cf044ed743da726ec1c2bf9a4316c1b5f2f84e4044f991eb"}
Jul 06 19:55:08.221722 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:08.221325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:08.255682 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:08.255626    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t" podStartSLOduration=1.560851974 podStartE2EDuration="4.255607908s" totalImagesPullingTime="2.694755934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:08.254559666 +0000 UTC m=+247.638218418" watchObservedRunningTime="2026-07-06 19:55:08.255607908 +0000 UTC m=+247.639266656"
Jul 06 19:55:08.453738 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:08.453702    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:08.632814 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:08.632779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:13.726967 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:13.726918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:14.228279 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:14.228252    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7qd9t"
Jul 06 19:55:15.270840 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:15.270804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:15.364781 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:15.364740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:15.541305 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:15.541210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:15.609994 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:15.609955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:16.647234 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.647198    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"]
Jul 06 19:55:16.650665 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.650640    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.652971 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.652951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fcbjt\""
Jul 06 19:55:16.653596 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.653577    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:55:16.653694 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.653628    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:55:16.662210 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.662185    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"]
Jul 06 19:55:16.741318 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.741270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23778d7d-0902-42a5-9817-5ab3dfe4c31a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-swk8r\" (UID: \"23778d7d-0902-42a5-9817-5ab3dfe4c31a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.741505 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.741323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtc4h\" (UniqueName: \"kubernetes.io/projected/23778d7d-0902-42a5-9817-5ab3dfe4c31a-kube-api-access-rtc4h\") pod \"openshift-lws-operator-fd8ccff4c-swk8r\" (UID: \"23778d7d-0902-42a5-9817-5ab3dfe4c31a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.842296 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.842249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23778d7d-0902-42a5-9817-5ab3dfe4c31a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-swk8r\" (UID: \"23778d7d-0902-42a5-9817-5ab3dfe4c31a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.842476 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.842310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtc4h\" (UniqueName: \"kubernetes.io/projected/23778d7d-0902-42a5-9817-5ab3dfe4c31a-kube-api-access-rtc4h\") pod \"openshift-lws-operator-fd8ccff4c-swk8r\" (UID: \"23778d7d-0902-42a5-9817-5ab3dfe4c31a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.842741 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.842717    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23778d7d-0902-42a5-9817-5ab3dfe4c31a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-swk8r\" (UID: \"23778d7d-0902-42a5-9817-5ab3dfe4c31a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.852729 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.852699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtc4h\" (UniqueName: \"kubernetes.io/projected/23778d7d-0902-42a5-9817-5ab3dfe4c31a-kube-api-access-rtc4h\") pod \"openshift-lws-operator-fd8ccff4c-swk8r\" (UID: \"23778d7d-0902-42a5-9817-5ab3dfe4c31a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:16.960034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:16.959943    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"
Jul 06 19:55:17.106724 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:17.106691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r"]
Jul 06 19:55:17.109845 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:55:17.109816    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23778d7d_0902_42a5_9817_5ab3dfe4c31a.slice/crio-c3ec44f275fcec79d4321166299b0273df5bb5e3cda37576afbabc3e1c723885 WatchSource:0}: Error finding container c3ec44f275fcec79d4321166299b0273df5bb5e3cda37576afbabc3e1c723885: Status 404 returned error can't find the container with id c3ec44f275fcec79d4321166299b0273df5bb5e3cda37576afbabc3e1c723885
Jul 06 19:55:17.261712 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:17.261626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r" event={"ID":"23778d7d-0902-42a5-9817-5ab3dfe4c31a","Type":"ContainerStarted","Data":"c3ec44f275fcec79d4321166299b0273df5bb5e3cda37576afbabc3e1c723885"}
Jul 06 19:55:23.559226 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:23.559135    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:31.327283 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:31.327248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r" event={"ID":"23778d7d-0902-42a5-9817-5ab3dfe4c31a","Type":"ContainerStarted","Data":"269e9c95d0adb9798c8c16e75281883fc528306ee0027b11c850623d33747318"}
Jul 06 19:55:31.347431 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:31.347343    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swk8r" podStartSLOduration=1.228914042 podStartE2EDuration="15.347319841s" totalImagesPullingTime="14.118405799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:31.346271265 +0000 UTC m=+270.729930014" watchObservedRunningTime="2026-07-06 19:55:31.347319841 +0000 UTC m=+270.730978594"
Jul 06 19:55:32.059453 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:32.059408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:32.158183 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:32.158141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.289355 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:34.289315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:49.164623 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:49.164588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:49.294802 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:49.294769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:49.974510 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:49.974472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:50.292787 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.292675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:50.428416 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.428356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"]
Jul 06 19:55:50.432084 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.432064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.435293 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.435272    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:55:50.435544 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.435531    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:55:50.435639 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.435618    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t6rmq\""
Jul 06 19:55:50.435708 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.435656    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:55:50.435860 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.435848    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:55:50.454564 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.454532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:50.455787 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.455762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"]
Jul 06 19:55:50.528394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.528320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9kln\" (UniqueName: \"kubernetes.io/projected/93437268-e618-4314-91bb-fbb67fd27994-kube-api-access-r9kln\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.528394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.528397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93437268-e618-4314-91bb-fbb67fd27994-webhook-cert\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.528608 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.528431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93437268-e618-4314-91bb-fbb67fd27994-tmp\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.528608 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.528447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93437268-e618-4314-91bb-fbb67fd27994-manifests\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.528608 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.528512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93437268-e618-4314-91bb-fbb67fd27994-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.629488 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.629451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93437268-e618-4314-91bb-fbb67fd27994-webhook-cert\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.629696 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.629497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93437268-e618-4314-91bb-fbb67fd27994-tmp\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.629696 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.629523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93437268-e618-4314-91bb-fbb67fd27994-manifests\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.629696 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.629568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93437268-e618-4314-91bb-fbb67fd27994-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.629696 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.629646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9kln\" (UniqueName: \"kubernetes.io/projected/93437268-e618-4314-91bb-fbb67fd27994-kube-api-access-r9kln\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.630026 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.629998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93437268-e618-4314-91bb-fbb67fd27994-manifests\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.632017 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.631995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93437268-e618-4314-91bb-fbb67fd27994-tmp\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.632248 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.632224    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93437268-e618-4314-91bb-fbb67fd27994-webhook-cert\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.632319 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.632308    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93437268-e618-4314-91bb-fbb67fd27994-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.641856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.641824    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9kln\" (UniqueName: \"kubernetes.io/projected/93437268-e618-4314-91bb-fbb67fd27994-kube-api-access-r9kln\") pod \"opendatahub-operator-controller-manager-549b57869c-ltkkm\" (UID: \"93437268-e618-4314-91bb-fbb67fd27994\") " pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.743022 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.742990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:50.762669 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.762631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:50.863000 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.862956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:50.902650 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.902571    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"]
Jul 06 19:55:50.905739 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:55:50.905707    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93437268_e618_4314_91bb_fbb67fd27994.slice/crio-feb973cc8c2d52a7db1c9baed8dc27baf312de8ebc7ba7497803b5b4aeea8613 WatchSource:0}: Error finding container feb973cc8c2d52a7db1c9baed8dc27baf312de8ebc7ba7497803b5b4aeea8613: Status 404 returned error can't find the container with id feb973cc8c2d52a7db1c9baed8dc27baf312de8ebc7ba7497803b5b4aeea8613
Jul 06 19:55:50.963675 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:50.963644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:51.065258 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:51.065217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:51.204406 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:51.204272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:51.292284 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:51.292202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:51.414616 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:51.414582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm" event={"ID":"93437268-e618-4314-91bb-fbb67fd27994","Type":"ContainerStarted","Data":"feb973cc8c2d52a7db1c9baed8dc27baf312de8ebc7ba7497803b5b4aeea8613"}
Jul 06 19:55:54.434461 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:54.434415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm" event={"ID":"93437268-e618-4314-91bb-fbb67fd27994","Type":"ContainerStarted","Data":"4ec381fb9cda9602a0c3f887f8793852504ddb6f74de9a149b5eb39df431b049"}
Jul 06 19:55:55.440580 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:55.440494    2581 generic.go:356] "Generic (PLEG): container finished" podID="93437268-e618-4314-91bb-fbb67fd27994" containerID="4ec381fb9cda9602a0c3f887f8793852504ddb6f74de9a149b5eb39df431b049" exitCode=0
Jul 06 19:55:55.440580 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:55.440540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm" event={"ID":"93437268-e618-4314-91bb-fbb67fd27994","Type":"ContainerDied","Data":"4ec381fb9cda9602a0c3f887f8793852504ddb6f74de9a149b5eb39df431b049"}
Jul 06 19:55:56.447159 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:56.447124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm" event={"ID":"93437268-e618-4314-91bb-fbb67fd27994","Type":"ContainerStarted","Data":"93dc0de002e3fe78709cf8666aad49f3b9d7efe4c7f7a71404e8ef4db9b1e920"}
Jul 06 19:55:56.447601 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:56.447255    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:55:56.473589 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:55:56.473537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm" podStartSLOduration=2.020877658 podStartE2EDuration="6.473518941s" totalImagesPullingTime="3.356473669s" totalInitContainerRuntime="1.096167614s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:56.472324091 +0000 UTC m=+295.855982840" watchObservedRunningTime="2026-07-06 19:55:56.473518941 +0000 UTC m=+295.857177689"
Jul 06 19:56:00.935916 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:00.935879    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 19:56:00.938146 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:00.938119    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 19:56:00.949414 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:00.949386    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:56:03.254496 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:03.254457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.357645 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:03.357606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:07.460016 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:07.459987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-549b57869c-ltkkm"
Jul 06 19:56:09.202190 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.202150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:09.333403 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.333356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:09.676263 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.676233    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:09.753750 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.753713    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"]
Jul 06 19:56:09.757034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.757007    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.761203 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.761174    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-chc5t\""
Jul 06 19:56:09.761355 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.761177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:56:09.761497 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.761483    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:56:09.772316 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.772284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"]
Jul 06 19:56:09.802094 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.802062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5553ba-7139-42ee-916f-10f85f747ca8-tls-certs\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.802094 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.802100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f5553ba-7139-42ee-916f-10f85f747ca8-tmp\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.802328 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.802132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mz55\" (UniqueName: \"kubernetes.io/projected/3f5553ba-7139-42ee-916f-10f85f747ca8-kube-api-access-5mz55\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.902998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.902962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mz55\" (UniqueName: \"kubernetes.io/projected/3f5553ba-7139-42ee-916f-10f85f747ca8-kube-api-access-5mz55\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.903183 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.903069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5553ba-7139-42ee-916f-10f85f747ca8-tls-certs\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.903183 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.903101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f5553ba-7139-42ee-916f-10f85f747ca8-tmp\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.905686 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.905650    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f5553ba-7139-42ee-916f-10f85f747ca8-tmp\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.905831 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.905816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f5553ba-7139-42ee-916f-10f85f747ca8-tls-certs\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.924246 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.924217    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mz55\" (UniqueName: \"kubernetes.io/projected/3f5553ba-7139-42ee-916f-10f85f747ca8-kube-api-access-5mz55\") pod \"kube-auth-proxy-5bf55b576c-94ghc\" (UID: \"3f5553ba-7139-42ee-916f-10f85f747ca8\") " pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:09.982754 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:09.982655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.067518 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.067481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"
Jul 06 19:56:10.116535 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.116493    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.239576 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.239551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc"]
Jul 06 19:56:10.241798 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:56:10.241771    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5553ba_7139_42ee_916f_10f85f747ca8.slice/crio-e47fbfa56ca42ae65af6e9286e7f278fbb08ed2c0b46ab93e7354f54cd0c7e1e WatchSource:0}: Error finding container e47fbfa56ca42ae65af6e9286e7f278fbb08ed2c0b46ab93e7354f54cd0c7e1e: Status 404 returned error can't find the container with id e47fbfa56ca42ae65af6e9286e7f278fbb08ed2c0b46ab93e7354f54cd0c7e1e
Jul 06 19:56:10.243582 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.243561    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:56:10.258436 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.258404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.445025 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.444989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.515838 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.515752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc" event={"ID":"3f5553ba-7139-42ee-916f-10f85f747ca8","Type":"ContainerStarted","Data":"e47fbfa56ca42ae65af6e9286e7f278fbb08ed2c0b46ab93e7354f54cd0c7e1e"}
Jul 06 19:56:10.548841 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:10.548800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:11.522101 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.522067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:11.536280 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.536249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"]
Jul 06 19:56:11.539371 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.539343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.544891 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.544870    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:56:11.544996 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.544891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:56:11.545548 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.545528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:56:11.545987 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.545969    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:56:11.549511 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.549495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m9cnf\""
Jul 06 19:56:11.564399 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.564375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"]
Jul 06 19:56:11.614302 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.614486 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-token\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.614486 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-local-certs\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.614486 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-cacerts\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.614486 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-772jn\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-kube-api-access-772jn\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.614619 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.614619 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.614526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.642528 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.642495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:11.714836 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.714799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-token\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.714836 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.714838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-local-certs\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.715092 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.714856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-cacerts\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.715092 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.715000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-772jn\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-kube-api-access-772jn\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.715092 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.715086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.715233 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.715112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.715304 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.715277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.715768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.715747    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.717405 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.717356    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-local-certs\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.717497 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.717433    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-cacerts\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.717539 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.717523    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.717755 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.717739    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.726731 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.726707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-token\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.726938 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.726914    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-772jn\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-kube-api-access-772jn\") pod \"istiod-openshift-gateway-7574459656-9z9wm\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:11.848847 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:11.848814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:12.025081 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:12.025057    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"]
Jul 06 19:56:12.027408 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:56:12.027356    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de62e64_e6a8_4f67_ac3e_27d00de7ed39.slice/crio-a78061be34e31f71b2c811f5226576fb7c16bf7ec59f02b979cd1e4a974bf331 WatchSource:0}: Error finding container a78061be34e31f71b2c811f5226576fb7c16bf7ec59f02b979cd1e4a974bf331: Status 404 returned error can't find the container with id a78061be34e31f71b2c811f5226576fb7c16bf7ec59f02b979cd1e4a974bf331
Jul 06 19:56:12.052994 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:12.052958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:12.528848 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:12.528812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" event={"ID":"7de62e64-e6a8-4f67-ac3e-27d00de7ed39","Type":"ContainerStarted","Data":"a78061be34e31f71b2c811f5226576fb7c16bf7ec59f02b979cd1e4a974bf331"}
Jul 06 19:56:12.942060 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:12.942023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:13.538326 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:13.538226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc" event={"ID":"3f5553ba-7139-42ee-916f-10f85f747ca8","Type":"ContainerStarted","Data":"9d0cba15272153d4c5c4ed9e42efb8b2409ca502daaa1c34cd93bdf067298db4"}
Jul 06 19:56:13.555779 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:13.555721    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bf55b576c-94ghc" podStartSLOduration=1.6570804730000002 podStartE2EDuration="4.55570338s" totalImagesPullingTime="2.898622907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:13.55427138 +0000 UTC m=+312.937930184" watchObservedRunningTime="2026-07-06 19:56:13.55570338 +0000 UTC m=+312.939362129"
Jul 06 19:56:18.926314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:18.926278    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:56:18.926605 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:18.926349    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:56:19.568408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:19.568344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" event={"ID":"7de62e64-e6a8-4f67-ac3e-27d00de7ed39","Type":"ContainerStarted","Data":"672ea438d4e2b3d766bb1c767464741fd838a9e5d5fa82f91c993b3e6671afa6"}
Jul 06 19:56:19.568612 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:19.568428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:19.570036 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:19.570004    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9z9wm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:56:19.570178 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:19.570077    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:56:19.687961 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:19.687906    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" podStartSLOduration=1.792289706 podStartE2EDuration="8.687889009s" totalImagesPullingTime="6.895599303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:19.685052798 +0000 UTC m=+319.068711547" watchObservedRunningTime="2026-07-06 19:56:19.687889009 +0000 UTC m=+319.071547757"
Jul 06 19:56:19.862320 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:19.862230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:20.211730 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.211647    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"]
Jul 06 19:56:20.215157 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.215137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.220549 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.220526    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dtmf5\""
Jul 06 19:56:20.245686 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.245650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"]
Jul 06 19:56:20.287408 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287600 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287600 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287600 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287756 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287756 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrr5\" (UniqueName: \"kubernetes.io/projected/6e59f972-4a34-4543-8818-9d4a0b9f389c-kube-api-access-jhrr5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.287953 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.287914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e59f972-4a34-4543-8818-9d4a0b9f389c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.388933 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.388891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389110 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.388949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrr5\" (UniqueName: \"kubernetes.io/projected/6e59f972-4a34-4543-8818-9d4a0b9f389c-kube-api-access-jhrr5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389110 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.388973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389110 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.388992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389110 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e59f972-4a34-4543-8818-9d4a0b9f389c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389110 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389110 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389435 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389435 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389591 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389568    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389693 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389668    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389752 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.389752 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.389706    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.390214 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.390187    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e59f972-4a34-4543-8818-9d4a0b9f389c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.391755 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.391733    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.392050 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.392031    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.404005 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.403967    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrr5\" (UniqueName: \"kubernetes.io/projected/6e59f972-4a34-4543-8818-9d4a0b9f389c-kube-api-access-jhrr5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.405231 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.405204    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e59f972-4a34-4543-8818-9d4a0b9f389c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kxw5q\" (UID: \"6e59f972-4a34-4543-8818-9d4a0b9f389c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.526426 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.526295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:20.574020 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.573986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:20.682111 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:20.682080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"]
Jul 06 19:56:20.683960 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:56:20.683933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e59f972_4a34_4543_8818_9d4a0b9f389c.slice/crio-16e30881eeb4f585600ba98f59b1a5ab238d52838362b1e49cdd522b1455adbd WatchSource:0}: Error finding container 16e30881eeb4f585600ba98f59b1a5ab238d52838362b1e49cdd522b1455adbd: Status 404 returned error can't find the container with id 16e30881eeb4f585600ba98f59b1a5ab238d52838362b1e49cdd522b1455adbd
Jul 06 19:56:21.492420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:21.492349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:21.579023 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:21.578993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q" event={"ID":"6e59f972-4a34-4543-8818-9d4a0b9f389c","Type":"ContainerStarted","Data":"16e30881eeb4f585600ba98f59b1a5ab238d52838362b1e49cdd522b1455adbd"}
Jul 06 19:56:22.915529 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:22.915485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.063287 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.063247    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-679cc"]
Jul 06 19:56:23.070411 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.070380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.082247 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.082221    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"]
Jul 06 19:56:23.084711 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.084686    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-x4wjm\""
Jul 06 19:56:23.085117 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.085095    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 19:56:23.087998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.087972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.089670 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.089637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.092519 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.092491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 19:56:23.092652 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.092548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bpnb4\""
Jul 06 19:56:23.100447 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.100387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-679cc"]
Jul 06 19:56:23.113469 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.113432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"]
Jul 06 19:56:23.118727 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.118686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156198ce-4a5d-425e-8a60-7e04d566a21e-cert\") pod \"kserve-controller-manager-d6f4b65b8-679cc\" (UID: \"156198ce-4a5d-425e-8a60-7e04d566a21e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.118925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.118826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5644e8a4-0902-4360-b2a9-80d8ec61c0c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tvrs2\" (UID: \"5644e8a4-0902-4360-b2a9-80d8ec61c0c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.118925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.118861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdddn\" (UniqueName: \"kubernetes.io/projected/5644e8a4-0902-4360-b2a9-80d8ec61c0c5-kube-api-access-rdddn\") pod \"llmisvc-controller-manager-777c6bd7d5-tvrs2\" (UID: \"5644e8a4-0902-4360-b2a9-80d8ec61c0c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.118925 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.118888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcbcl\" (UniqueName: \"kubernetes.io/projected/156198ce-4a5d-425e-8a60-7e04d566a21e-kube-api-access-fcbcl\") pod \"kserve-controller-manager-d6f4b65b8-679cc\" (UID: \"156198ce-4a5d-425e-8a60-7e04d566a21e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.212906 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.212811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.219807 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.219774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5644e8a4-0902-4360-b2a9-80d8ec61c0c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tvrs2\" (UID: \"5644e8a4-0902-4360-b2a9-80d8ec61c0c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.219998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.219825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdddn\" (UniqueName: \"kubernetes.io/projected/5644e8a4-0902-4360-b2a9-80d8ec61c0c5-kube-api-access-rdddn\") pod \"llmisvc-controller-manager-777c6bd7d5-tvrs2\" (UID: \"5644e8a4-0902-4360-b2a9-80d8ec61c0c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.219998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.219857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcbcl\" (UniqueName: \"kubernetes.io/projected/156198ce-4a5d-425e-8a60-7e04d566a21e-kube-api-access-fcbcl\") pod \"kserve-controller-manager-d6f4b65b8-679cc\" (UID: \"156198ce-4a5d-425e-8a60-7e04d566a21e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.219998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.219910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156198ce-4a5d-425e-8a60-7e04d566a21e-cert\") pod \"kserve-controller-manager-d6f4b65b8-679cc\" (UID: \"156198ce-4a5d-425e-8a60-7e04d566a21e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.222566 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.222539    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156198ce-4a5d-425e-8a60-7e04d566a21e-cert\") pod \"kserve-controller-manager-d6f4b65b8-679cc\" (UID: \"156198ce-4a5d-425e-8a60-7e04d566a21e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.222690 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.222645    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5644e8a4-0902-4360-b2a9-80d8ec61c0c5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tvrs2\" (UID: \"5644e8a4-0902-4360-b2a9-80d8ec61c0c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.237493 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.237455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdddn\" (UniqueName: \"kubernetes.io/projected/5644e8a4-0902-4360-b2a9-80d8ec61c0c5-kube-api-access-rdddn\") pod \"llmisvc-controller-manager-777c6bd7d5-tvrs2\" (UID: \"5644e8a4-0902-4360-b2a9-80d8ec61c0c5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.237690 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.237669    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcbcl\" (UniqueName: \"kubernetes.io/projected/156198ce-4a5d-425e-8a60-7e04d566a21e-kube-api-access-fcbcl\") pod \"kserve-controller-manager-d6f4b65b8-679cc\" (UID: \"156198ce-4a5d-425e-8a60-7e04d566a21e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.338550 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.338513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.385502 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.385463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:23.402741 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.402695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:23.465967 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.465856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.609442 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.607965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-679cc"]
Jul 06 19:56:23.620329 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:56:23.620289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156198ce_4a5d_425e_8a60_7e04d566a21e.slice/crio-d77e544cd08966b63caeb3d4d37ff12b7e16c86c9d97f4ec32fd9984aceef7d5 WatchSource:0}: Error finding container d77e544cd08966b63caeb3d4d37ff12b7e16c86c9d97f4ec32fd9984aceef7d5: Status 404 returned error can't find the container with id d77e544cd08966b63caeb3d4d37ff12b7e16c86c9d97f4ec32fd9984aceef7d5
Jul 06 19:56:23.667905 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:23.667878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"]
Jul 06 19:56:23.669051 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:56:23.669023    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5644e8a4_0902_4360_b2a9_80d8ec61c0c5.slice/crio-a7528723a7146aded3c48df8b766538175483d3740e08cb148824c4f8d149d4b WatchSource:0}: Error finding container a7528723a7146aded3c48df8b766538175483d3740e08cb148824c4f8d149d4b: Status 404 returned error can't find the container with id a7528723a7146aded3c48df8b766538175483d3740e08cb148824c4f8d149d4b
Jul 06 19:56:24.598521 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:24.598467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2" event={"ID":"5644e8a4-0902-4360-b2a9-80d8ec61c0c5","Type":"ContainerStarted","Data":"a7528723a7146aded3c48df8b766538175483d3740e08cb148824c4f8d149d4b"}
Jul 06 19:56:24.599857 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:24.599823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc" event={"ID":"156198ce-4a5d-425e-8a60-7e04d566a21e","Type":"ContainerStarted","Data":"d77e544cd08966b63caeb3d4d37ff12b7e16c86c9d97f4ec32fd9984aceef7d5"}
Jul 06 19:56:25.064940 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:25.064897    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:56:25.065027 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:25.064986    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:56:25.065027 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:25.065021    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:56:25.608162 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:25.608120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q" event={"ID":"6e59f972-4a34-4543-8818-9d4a0b9f389c","Type":"ContainerStarted","Data":"7ec5e5225aa5f9fb142c8a467bd43c9caf0c3d27b82d42c5ced1319c62872e2c"}
Jul 06 19:56:25.659891 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:25.659821    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q" podStartSLOduration=1.281565595 podStartE2EDuration="5.65979569s" totalImagesPullingTime="4.378230095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:25.657503015 +0000 UTC m=+325.041161779" watchObservedRunningTime="2026-07-06 19:56:25.65979569 +0000 UTC m=+325.043454443"
Jul 06 19:56:26.527202 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:26.527157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:26.533566 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:26.533528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:26.616850 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:26.616818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:26.618466 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:26.618275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kxw5q"
Jul 06 19:56:28.629019 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:28.628970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2" event={"ID":"5644e8a4-0902-4360-b2a9-80d8ec61c0c5","Type":"ContainerStarted","Data":"4e0283623e566090e5ff609a154e8600aef7e2fe2e6e8d9bdce6a8a7a6d10b90"}
Jul 06 19:56:28.629526 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:28.629052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:56:28.630443 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:28.630416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc" event={"ID":"156198ce-4a5d-425e-8a60-7e04d566a21e","Type":"ContainerStarted","Data":"d2cb47a544726fb35dd14fc697bbf8ba3c917569e0f690ea456329440d0ce669"}
Jul 06 19:56:28.652891 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:28.652835    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2" podStartSLOduration=1.4202786139999999 podStartE2EDuration="5.652818006s" totalImagesPullingTime="4.232539392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:28.650636553 +0000 UTC m=+328.034295302" watchObservedRunningTime="2026-07-06 19:56:28.652818006 +0000 UTC m=+328.036476831"
Jul 06 19:56:28.681053 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:28.681000    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc" podStartSLOduration=1.405827883 podStartE2EDuration="5.680980882s" totalImagesPullingTime="4.275152999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:28.678018196 +0000 UTC m=+328.061676946" watchObservedRunningTime="2026-07-06 19:56:28.680980882 +0000 UTC m=+328.064639631"
Jul 06 19:56:29.469579 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.469543    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"]
Jul 06 19:56:29.469777 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.469741    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerName="discovery" containerID="cri-o://672ea438d4e2b3d766bb1c767464741fd838a9e5d5fa82f91c993b3e6671afa6" gracePeriod=30
Jul 06 19:56:29.574585 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.574543    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9z9wm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.31:8080/ready\": dial tcp 10.132.0.31:8080: connect: connection refused" start-of-body=
Jul 06 19:56:29.574760 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.574617    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.31:8080/ready\": dial tcp 10.132.0.31:8080: connect: connection refused"
Jul 06 19:56:29.637116 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.637078    2581 generic.go:356] "Generic (PLEG): container finished" podID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerID="672ea438d4e2b3d766bb1c767464741fd838a9e5d5fa82f91c993b3e6671afa6" exitCode=0
Jul 06 19:56:29.637558 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.637162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" event={"ID":"7de62e64-e6a8-4f67-ac3e-27d00de7ed39","Type":"ContainerDied","Data":"672ea438d4e2b3d766bb1c767464741fd838a9e5d5fa82f91c993b3e6671afa6"}
Jul 06 19:56:29.637883 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.637823    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:56:29.718679 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.718653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:29.785550 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785455    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-token\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.785550 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-local-certs\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.785550 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785527    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-cacerts\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.785823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785566    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-kubeconfig\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.785823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785617    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-ca-configmap\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.785823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-dns-cert\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.785823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.785658    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-772jn\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-kube-api-access-772jn\") pod \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\" (UID: \"7de62e64-e6a8-4f67-ac3e-27d00de7ed39\") "
Jul 06 19:56:29.786068 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.786041    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:56:29.788056 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.788024    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-cacerts" (OuterVolumeSpecName: "cacerts") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:56:29.788394 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.788346    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-kube-api-access-772jn" (OuterVolumeSpecName: "kube-api-access-772jn") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "kube-api-access-772jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:56:29.788531 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.788504    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-local-certs" (OuterVolumeSpecName: "local-certs") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:56:29.788531 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.788508    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-token" (OuterVolumeSpecName: "istio-token") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:56:29.788678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.788596    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:56:29.788678 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.788598    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7de62e64-e6a8-4f67-ac3e-27d00de7ed39" (UID: "7de62e64-e6a8-4f67-ac3e-27d00de7ed39"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:56:29.886306 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886261    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-local-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:29.886306 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886295    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-cacerts\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:29.886306 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886305    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-kubeconfig\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:29.886306 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886314    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-ca-configmap\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:29.886604 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886324    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-csr-dns-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:29.886604 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886333    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-772jn\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-kube-api-access-772jn\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:29.886604 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:29.886341    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de62e64-e6a8-4f67-ac3e-27d00de7ed39-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:56:30.644273 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:30.644239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm" event={"ID":"7de62e64-e6a8-4f67-ac3e-27d00de7ed39","Type":"ContainerDied","Data":"a78061be34e31f71b2c811f5226576fb7c16bf7ec59f02b979cd1e4a974bf331"}
Jul 06 19:56:30.644273 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:30.644257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"
Jul 06 19:56:30.644822 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:30.644299    2581 scope.go:117] "RemoveContainer" containerID="672ea438d4e2b3d766bb1c767464741fd838a9e5d5fa82f91c993b3e6671afa6"
Jul 06 19:56:30.665728 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:30.665697    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"]
Jul 06 19:56:30.671610 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:30.671584    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9z9wm"]
Jul 06 19:56:31.023766 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:31.023688    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" path="/var/lib/kubelet/pods/7de62e64-e6a8-4f67-ac3e-27d00de7ed39/volumes"
Jul 06 19:56:59.640417 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:56:59.640317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 19:57:00.649834 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:00.649802    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 19:57:10.688281 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.688239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:10.785449 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.785411    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7jxs"]
Jul 06 19:57:10.785800 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.785788    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerName="discovery"
Jul 06 19:57:10.785844 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.785802    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerName="discovery"
Jul 06 19:57:10.785885 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.785876    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de62e64-e6a8-4f67-ac3e-27d00de7ed39" containerName="discovery"
Jul 06 19:57:10.795113 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.795085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:10.798831 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.798803    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:57:10.800352 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.800336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rp6h2\""
Jul 06 19:57:10.800772 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.800751    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:57:10.806415 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.806354    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7jxs"]
Jul 06 19:57:10.835270 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.835237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:10.843532 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.843504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9sj6\" (UniqueName: \"kubernetes.io/projected/a14f9f46-f2f9-49e1-8d42-11d4a6289f60-kube-api-access-m9sj6\") pod \"kuadrant-operator-catalog-r7jxs\" (UID: \"a14f9f46-f2f9-49e1-8d42-11d4a6289f60\") " pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:10.944171 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.944068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9sj6\" (UniqueName: \"kubernetes.io/projected/a14f9f46-f2f9-49e1-8d42-11d4a6289f60-kube-api-access-m9sj6\") pod \"kuadrant-operator-catalog-r7jxs\" (UID: \"a14f9f46-f2f9-49e1-8d42-11d4a6289f60\") " pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:10.944341 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.944107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:10.955308 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:10.955283    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9sj6\" (UniqueName: \"kubernetes.io/projected/a14f9f46-f2f9-49e1-8d42-11d4a6289f60-kube-api-access-m9sj6\") pod \"kuadrant-operator-catalog-r7jxs\" (UID: \"a14f9f46-f2f9-49e1-8d42-11d4a6289f60\") " pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:11.108489 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.108443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:11.131245 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.131210    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7jxs"]
Jul 06 19:57:11.261450 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.261312    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7jxs"]
Jul 06 19:57:11.264532 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:57:11.264494    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14f9f46_f2f9_49e1_8d42_11d4a6289f60.slice/crio-dfe2ed52cfd5f4b847c5e40675c63048773dcbc8d4a35464a599692bc5d0ae07 WatchSource:0}: Error finding container dfe2ed52cfd5f4b847c5e40675c63048773dcbc8d4a35464a599692bc5d0ae07: Status 404 returned error can't find the container with id dfe2ed52cfd5f4b847c5e40675c63048773dcbc8d4a35464a599692bc5d0ae07
Jul 06 19:57:11.358764 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.358732    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc6nl"]
Jul 06 19:57:11.363457 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.363437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:11.377884 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.377853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc6nl"]
Jul 06 19:57:11.448130 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.448033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsb9l\" (UniqueName: \"kubernetes.io/projected/8d370138-210f-463f-ac34-14c238079430-kube-api-access-jsb9l\") pod \"kuadrant-operator-catalog-pc6nl\" (UID: \"8d370138-210f-463f-ac34-14c238079430\") " pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:11.548831 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.548789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsb9l\" (UniqueName: \"kubernetes.io/projected/8d370138-210f-463f-ac34-14c238079430-kube-api-access-jsb9l\") pod \"kuadrant-operator-catalog-pc6nl\" (UID: \"8d370138-210f-463f-ac34-14c238079430\") " pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:11.558055 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.558024    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsb9l\" (UniqueName: \"kubernetes.io/projected/8d370138-210f-463f-ac34-14c238079430-kube-api-access-jsb9l\") pod \"kuadrant-operator-catalog-pc6nl\" (UID: \"8d370138-210f-463f-ac34-14c238079430\") " pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:11.672556 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.672509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:11.821011 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.820917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc6nl"]
Jul 06 19:57:11.823388 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:57:11.823340    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d370138_210f_463f_ac34_14c238079430.slice/crio-27032c550669dccdb61fc007945c1a5d17c6557fd71223e43ce3fa3bfb8a504e WatchSource:0}: Error finding container 27032c550669dccdb61fc007945c1a5d17c6557fd71223e43ce3fa3bfb8a504e: Status 404 returned error can't find the container with id 27032c550669dccdb61fc007945c1a5d17c6557fd71223e43ce3fa3bfb8a504e
Jul 06 19:57:11.854719 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.854127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl" event={"ID":"8d370138-210f-463f-ac34-14c238079430","Type":"ContainerStarted","Data":"27032c550669dccdb61fc007945c1a5d17c6557fd71223e43ce3fa3bfb8a504e"}
Jul 06 19:57:11.856072 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:11.856038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs" event={"ID":"a14f9f46-f2f9-49e1-8d42-11d4a6289f60","Type":"ContainerStarted","Data":"dfe2ed52cfd5f4b847c5e40675c63048773dcbc8d4a35464a599692bc5d0ae07"}
Jul 06 19:57:13.869882 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:13.869842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl" event={"ID":"8d370138-210f-463f-ac34-14c238079430","Type":"ContainerStarted","Data":"c3ba57af19dda0c3cb3946296a46e188a71edeedfc04586b4f7fc744b7ffa8d0"}
Jul 06 19:57:13.871454 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:13.871423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs" event={"ID":"a14f9f46-f2f9-49e1-8d42-11d4a6289f60","Type":"ContainerStarted","Data":"0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5"}
Jul 06 19:57:13.871592 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:13.871476    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs" podUID="a14f9f46-f2f9-49e1-8d42-11d4a6289f60" containerName="registry-server" containerID="cri-o://0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5" gracePeriod=2
Jul 06 19:57:13.889514 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:13.889462    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl" podStartSLOduration=1.239451907 podStartE2EDuration="2.88944352s" totalImagesPullingTime="1.649991613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:13.887213211 +0000 UTC m=+373.270871961" watchObservedRunningTime="2026-07-06 19:57:13.88944352 +0000 UTC m=+373.273102268"
Jul 06 19:57:13.908763 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:13.908705    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs" podStartSLOduration=1.702638131 podStartE2EDuration="3.908684465s" totalImagesPullingTime="2.206046334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:13.907986024 +0000 UTC m=+373.291644773" watchObservedRunningTime="2026-07-06 19:57:13.908684465 +0000 UTC m=+373.292343213"
Jul 06 19:57:14.125078 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.125011    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:14.173372 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.173313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9sj6\" (UniqueName: \"kubernetes.io/projected/a14f9f46-f2f9-49e1-8d42-11d4a6289f60-kube-api-access-m9sj6\") pod \"a14f9f46-f2f9-49e1-8d42-11d4a6289f60\" (UID: \"a14f9f46-f2f9-49e1-8d42-11d4a6289f60\") "
Jul 06 19:57:14.175716 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.175693    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a14f9f46-f2f9-49e1-8d42-11d4a6289f60-kube-api-access-m9sj6" (OuterVolumeSpecName: "kube-api-access-m9sj6") pod "a14f9f46-f2f9-49e1-8d42-11d4a6289f60" (UID: "a14f9f46-f2f9-49e1-8d42-11d4a6289f60"). InnerVolumeSpecName "kube-api-access-m9sj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:14.274468 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.274424    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9sj6\" (UniqueName: \"kubernetes.io/projected/a14f9f46-f2f9-49e1-8d42-11d4a6289f60-kube-api-access-m9sj6\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:57:14.877318 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.877279    2581 generic.go:356] "Generic (PLEG): container finished" podID="a14f9f46-f2f9-49e1-8d42-11d4a6289f60" containerID="0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5" exitCode=0
Jul 06 19:57:14.877780 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.877328    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs"
Jul 06 19:57:14.877780 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.877378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs" event={"ID":"a14f9f46-f2f9-49e1-8d42-11d4a6289f60","Type":"ContainerDied","Data":"0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5"}
Jul 06 19:57:14.877780 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.877430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r7jxs" event={"ID":"a14f9f46-f2f9-49e1-8d42-11d4a6289f60","Type":"ContainerDied","Data":"dfe2ed52cfd5f4b847c5e40675c63048773dcbc8d4a35464a599692bc5d0ae07"}
Jul 06 19:57:14.877780 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.877450    2581 scope.go:117] "RemoveContainer" containerID="0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5"
Jul 06 19:57:14.886779 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.886757    2581 scope.go:117] "RemoveContainer" containerID="0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5"
Jul 06 19:57:14.887105 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:57:14.887086    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5\": container with ID starting with 0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5 not found: ID does not exist" containerID="0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5"
Jul 06 19:57:14.887154 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.887116    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5"} err="failed to get container status \"0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5\": rpc error: code = NotFound desc = could not find container \"0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5\": container with ID starting with 0654d534874fabafa1fa684fb1a84d0dd4bf8a379ab7ece9f147681929232ce5 not found: ID does not exist"
Jul 06 19:57:14.899248 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.899209    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7jxs"]
Jul 06 19:57:14.901895 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:14.901866    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r7jxs"]
Jul 06 19:57:15.023833 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:15.023791    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a14f9f46-f2f9-49e1-8d42-11d4a6289f60" path="/var/lib/kubelet/pods/a14f9f46-f2f9-49e1-8d42-11d4a6289f60/volumes"
Jul 06 19:57:15.599065 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:15.599031    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:15.664945 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:15.664905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:16.597565 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:16.597521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:17.550052 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:17.550015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:17.623047 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:17.623015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:21.672854 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:21.672820    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:21.673420 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:21.672897    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:21.696554 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:21.696527    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:21.938592 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:21.938507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pc6nl"
Jul 06 19:57:34.403768 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:34.403727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:34.990862 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:34.990826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:36.313307 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:36.313272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:38.293803 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.293762    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"]
Jul 06 19:57:38.294342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.294322    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14f9f46-f2f9-49e1-8d42-11d4a6289f60" containerName="registry-server"
Jul 06 19:57:38.294448 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.294347    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14f9f46-f2f9-49e1-8d42-11d4a6289f60" containerName="registry-server"
Jul 06 19:57:38.294501 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.294461    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a14f9f46-f2f9-49e1-8d42-11d4a6289f60" containerName="registry-server"
Jul 06 19:57:38.297641 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.297617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:38.299866 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.299843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sp88k\""
Jul 06 19:57:38.315934 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.315893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"]
Jul 06 19:57:38.392313 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.392254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76b8p\" (UniqueName: \"kubernetes.io/projected/7d5e6e05-6fbd-4411-960b-98727841f5a0-kube-api-access-76b8p\") pod \"authorino-operator-75cc8d5cb7-g5vkl\" (UID: \"7d5e6e05-6fbd-4411-960b-98727841f5a0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:38.493428 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.493352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76b8p\" (UniqueName: \"kubernetes.io/projected/7d5e6e05-6fbd-4411-960b-98727841f5a0-kube-api-access-76b8p\") pod \"authorino-operator-75cc8d5cb7-g5vkl\" (UID: \"7d5e6e05-6fbd-4411-960b-98727841f5a0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:38.503582 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.503553    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76b8p\" (UniqueName: \"kubernetes.io/projected/7d5e6e05-6fbd-4411-960b-98727841f5a0-kube-api-access-76b8p\") pod \"authorino-operator-75cc8d5cb7-g5vkl\" (UID: \"7d5e6e05-6fbd-4411-960b-98727841f5a0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:38.608353 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.608315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:38.753311 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.753272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"]
Jul 06 19:57:38.757222 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:57:38.757195    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5e6e05_6fbd_4411_960b_98727841f5a0.slice/crio-141cb1dd99dd4387924c31c60e6096b2d6ea101aa1bfb43d079664af2f6cb2aa WatchSource:0}: Error finding container 141cb1dd99dd4387924c31c60e6096b2d6ea101aa1bfb43d079664af2f6cb2aa: Status 404 returned error can't find the container with id 141cb1dd99dd4387924c31c60e6096b2d6ea101aa1bfb43d079664af2f6cb2aa
Jul 06 19:57:38.999801 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:38.999710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl" event={"ID":"7d5e6e05-6fbd-4411-960b-98727841f5a0","Type":"ContainerStarted","Data":"141cb1dd99dd4387924c31c60e6096b2d6ea101aa1bfb43d079664af2f6cb2aa"}
Jul 06 19:57:39.443248 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:39.443176    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:41.012357 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.012320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl" event={"ID":"7d5e6e05-6fbd-4411-960b-98727841f5a0","Type":"ContainerStarted","Data":"67ebf37cf6ad9d9fc3f922a35b9ffb7f88ed5766ddbb62c372b24108b12213c8"}
Jul 06 19:57:41.012784 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.012474    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:41.040424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.040345    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl" podStartSLOduration=0.86555459 podStartE2EDuration="3.040327532s" totalImagesPullingTime="2.174772942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:41.038955707 +0000 UTC m=+400.422614457" watchObservedRunningTime="2026-07-06 19:57:41.040327532 +0000 UTC m=+400.423986281"
Jul 06 19:57:41.310445 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.310411    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"]
Jul 06 19:57:41.313947 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.313928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:41.321680 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.321651    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:57:41.321842 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.321819    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8q92m\""
Jul 06 19:57:41.367387 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.367341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"]
Jul 06 19:57:41.421107 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.421069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz65z\" (UniqueName: \"kubernetes.io/projected/c331061b-5c62-42c8-bc60-3a80df948771-kube-api-access-cz65z\") pod \"dns-operator-controller-manager-864dd78c4c-mf6wj\" (UID: \"c331061b-5c62-42c8-bc60-3a80df948771\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:41.521597 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.521562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz65z\" (UniqueName: \"kubernetes.io/projected/c331061b-5c62-42c8-bc60-3a80df948771-kube-api-access-cz65z\") pod \"dns-operator-controller-manager-864dd78c4c-mf6wj\" (UID: \"c331061b-5c62-42c8-bc60-3a80df948771\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:41.533258 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.533219    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz65z\" (UniqueName: \"kubernetes.io/projected/c331061b-5c62-42c8-bc60-3a80df948771-kube-api-access-cz65z\") pod \"dns-operator-controller-manager-864dd78c4c-mf6wj\" (UID: \"c331061b-5c62-42c8-bc60-3a80df948771\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:41.624445 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.624339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:41.780969 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.780937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"]
Jul 06 19:57:41.783257 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:57:41.783230    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc331061b_5c62_42c8_bc60_3a80df948771.slice/crio-c6b91f7aacae3f5e30c1cf5d95b28ae2ddcda4fba876562caed8a692ddbe3344 WatchSource:0}: Error finding container c6b91f7aacae3f5e30c1cf5d95b28ae2ddcda4fba876562caed8a692ddbe3344: Status 404 returned error can't find the container with id c6b91f7aacae3f5e30c1cf5d95b28ae2ddcda4fba876562caed8a692ddbe3344
Jul 06 19:57:41.864181 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:41.864141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:42.019530 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:42.019434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj" event={"ID":"c331061b-5c62-42c8-bc60-3a80df948771","Type":"ContainerStarted","Data":"c6b91f7aacae3f5e30c1cf5d95b28ae2ddcda4fba876562caed8a692ddbe3344"}
Jul 06 19:57:42.118484 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:42.118447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:43.835617 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:43.835581    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"]
Jul 06 19:57:43.839711 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:43.839686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:57:43.843057 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:43.843033    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m8x9w\""
Jul 06 19:57:43.853939 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:43.853896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"]
Jul 06 19:57:43.947780 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:43.947743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhq6\" (UniqueName: \"kubernetes.io/projected/70443f7d-6a04-404f-adda-8f29aa071267-kube-api-access-vrhq6\") pod \"limitador-operator-controller-manager-859d7b78bd-5slj8\" (UID: \"70443f7d-6a04-404f-adda-8f29aa071267\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:57:44.032035 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.031993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj" event={"ID":"c331061b-5c62-42c8-bc60-3a80df948771","Type":"ContainerStarted","Data":"b8a29521db9e95bad8dc394f741b54df66d41b204cab14ea66c78b82a20be779"}
Jul 06 19:57:44.032242 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.032125    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:44.048590 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.048532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhq6\" (UniqueName: \"kubernetes.io/projected/70443f7d-6a04-404f-adda-8f29aa071267-kube-api-access-vrhq6\") pod \"limitador-operator-controller-manager-859d7b78bd-5slj8\" (UID: \"70443f7d-6a04-404f-adda-8f29aa071267\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:57:44.069342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.069288    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj" podStartSLOduration=0.987816495 podStartE2EDuration="3.069271192s" totalImagesPullingTime="2.081454697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:44.066769463 +0000 UTC m=+403.450428211" watchObservedRunningTime="2026-07-06 19:57:44.069271192 +0000 UTC m=+403.452929941"
Jul 06 19:57:44.069622 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.069598    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhq6\" (UniqueName: \"kubernetes.io/projected/70443f7d-6a04-404f-adda-8f29aa071267-kube-api-access-vrhq6\") pod \"limitador-operator-controller-manager-859d7b78bd-5slj8\" (UID: \"70443f7d-6a04-404f-adda-8f29aa071267\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:57:44.150328 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.150234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:57:44.312665 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.312630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:44.326488 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.326459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"]
Jul 06 19:57:44.329302 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:57:44.329272    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70443f7d_6a04_404f_adda_8f29aa071267.slice/crio-f47e7da75907145a601562fbf8d69c506b72404a4503c586df1782a5b9a62bb4 WatchSource:0}: Error finding container f47e7da75907145a601562fbf8d69c506b72404a4503c586df1782a5b9a62bb4: Status 404 returned error can't find the container with id f47e7da75907145a601562fbf8d69c506b72404a4503c586df1782a5b9a62bb4
Jul 06 19:57:44.412101 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:44.411994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:45.038357 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:45.038318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8" event={"ID":"70443f7d-6a04-404f-adda-8f29aa071267","Type":"ContainerStarted","Data":"f47e7da75907145a601562fbf8d69c506b72404a4503c586df1782a5b9a62bb4"}
Jul 06 19:57:46.981952 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:46.981914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:47.053811 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:47.053777    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8" event={"ID":"70443f7d-6a04-404f-adda-8f29aa071267","Type":"ContainerStarted","Data":"ed745dbb4857a08b3383bde4fdf447b36748eefcb21a4b5e9e3ed47faeee53b2"}
Jul 06 19:57:47.053993 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:47.053919    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:57:47.168173 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:47.168106    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8" podStartSLOduration=2.432776188 podStartE2EDuration="4.168086599s" totalImagesPullingTime="1.735310411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:47.167859992 +0000 UTC m=+406.551518764" watchObservedRunningTime="2026-07-06 19:57:47.168086599 +0000 UTC m=+406.551745350"
Jul 06 19:57:48.388826 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.388778    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"]
Jul 06 19:57:48.392565 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.392545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.395170 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.395150    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nsjzn\""
Jul 06 19:57:48.407784 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.407757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"]
Jul 06 19:57:48.489548 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.489503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5682d44c-b185-4e8b-8956-e7b213a2b5ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.489756 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.489566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntpfh\" (UniqueName: \"kubernetes.io/projected/5682d44c-b185-4e8b-8956-e7b213a2b5ad-kube-api-access-ntpfh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.590666 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.590626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntpfh\" (UniqueName: \"kubernetes.io/projected/5682d44c-b185-4e8b-8956-e7b213a2b5ad-kube-api-access-ntpfh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.590873 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.590728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5682d44c-b185-4e8b-8956-e7b213a2b5ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.591142 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.591119    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5682d44c-b185-4e8b-8956-e7b213a2b5ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.602634 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.602597    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntpfh\" (UniqueName: \"kubernetes.io/projected/5682d44c-b185-4e8b-8956-e7b213a2b5ad-kube-api-access-ntpfh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.703158 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.703065    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:48.851883 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:48.851856    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"]
Jul 06 19:57:48.854517 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:57:48.854490    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5682d44c_b185_4e8b_8956_e7b213a2b5ad.slice/crio-68d6f7921811b66882c1887b15a2f4ff955cefcb610dbf9553c97b41be72d028 WatchSource:0}: Error finding container 68d6f7921811b66882c1887b15a2f4ff955cefcb610dbf9553c97b41be72d028: Status 404 returned error can't find the container with id 68d6f7921811b66882c1887b15a2f4ff955cefcb610dbf9553c97b41be72d028
Jul 06 19:57:49.064636 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:49.064602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4" event={"ID":"5682d44c-b185-4e8b-8956-e7b213a2b5ad","Type":"ContainerStarted","Data":"68d6f7921811b66882c1887b15a2f4ff955cefcb610dbf9553c97b41be72d028"}
Jul 06 19:57:49.457438 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:49.457282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:49.576138 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:49.576097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:49.712080 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:49.711966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:52.022622 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:52.022589    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 19:57:53.241593 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:53.241556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:53.350406 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:53.350352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:55.041140 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:55.041112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 19:57:55.102006 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:55.101968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4" event={"ID":"5682d44c-b185-4e8b-8956-e7b213a2b5ad","Type":"ContainerStarted","Data":"75863342d1873a6f017e3621df1ef73c714de8aec5b59131815534ff349cb8b3"}
Jul 06 19:57:55.102198 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:55.102152    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:57:55.122819 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:55.122386    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4" podStartSLOduration=1.7811748509999998 podStartE2EDuration="7.122346377s" totalImagesPullingTime="5.341171526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:55.121707923 +0000 UTC m=+414.505366711" watchObservedRunningTime="2026-07-06 19:57:55.122346377 +0000 UTC m=+414.506005128"
Jul 06 19:57:56.890272 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:56.890235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:56.983848 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:56.983813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:57.228255 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:57.228171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:57.323181 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:57.323150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:58.060914 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:57:58.060879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:00.775095 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:00.775041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:00.876417 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:00.876374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:06.111503 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:06.111470    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:07.931732 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.931692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:07.945068 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.945035    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"]
Jul 06 19:58:07.945245 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.945224    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" containerName="manager" containerID="cri-o://75863342d1873a6f017e3621df1ef73c714de8aec5b59131815534ff349cb8b3" gracePeriod=2
Jul 06 19:58:07.957354 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.957310    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"]
Jul 06 19:58:07.989169 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.989133    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"]
Jul 06 19:58:07.989582 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.989423    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8" podUID="70443f7d-6a04-404f-adda-8f29aa071267" containerName="manager" containerID="cri-o://ed745dbb4857a08b3383bde4fdf447b36748eefcb21a4b5e9e3ed47faeee53b2" gracePeriod=2
Jul 06 19:58:07.994746 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.994713    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"]
Jul 06 19:58:07.995121 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.995108    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" containerName="manager"
Jul 06 19:58:07.995164 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.995123    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" containerName="manager"
Jul 06 19:58:07.995216 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.995206    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" containerName="manager"
Jul 06 19:58:07.998412 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:07.998329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.000174 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.000143    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"]
Jul 06 19:58:08.001882 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.001852    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:08.003472 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.003443    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5slj8\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="70443f7d-6a04-404f-adda-8f29aa071267" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:08.023877 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.023844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"]
Jul 06 19:58:08.030030 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.030000    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"]
Jul 06 19:58:08.030472 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.030454    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70443f7d-6a04-404f-adda-8f29aa071267" containerName="manager"
Jul 06 19:58:08.030557 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.030474    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="70443f7d-6a04-404f-adda-8f29aa071267" containerName="manager"
Jul 06 19:58:08.030610 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.030593    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="70443f7d-6a04-404f-adda-8f29aa071267" containerName="manager"
Jul 06 19:58:08.033680 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.033658    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:08.042976 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.042923    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:08.044532 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.044494    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:08.046289 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.046256    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5slj8\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="70443f7d-6a04-404f-adda-8f29aa071267" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:08.060484 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.060252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"]
Jul 06 19:58:08.061544 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.061461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:08.064192 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.064159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8zx\" (UniqueName: \"kubernetes.io/projected/ad290aee-7c8b-4e1e-beaa-3f9721e709be-kube-api-access-rk8zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dncwp\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.064307 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.064240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hvhv\" (UniqueName: \"kubernetes.io/projected/b8896722-ae74-457e-a266-f68cf5618bba-kube-api-access-9hvhv\") pod \"limitador-operator-controller-manager-859d7b78bd-st6gw\" (UID: \"b8896722-ae74-457e-a266-f68cf5618bba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:08.064407 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.064391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad290aee-7c8b-4e1e-beaa-3f9721e709be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dncwp\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.165587 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.164936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hvhv\" (UniqueName: \"kubernetes.io/projected/b8896722-ae74-457e-a266-f68cf5618bba-kube-api-access-9hvhv\") pod \"limitador-operator-controller-manager-859d7b78bd-st6gw\" (UID: \"b8896722-ae74-457e-a266-f68cf5618bba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:08.165587 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.165082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad290aee-7c8b-4e1e-beaa-3f9721e709be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dncwp\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.165587 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.165145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8zx\" (UniqueName: \"kubernetes.io/projected/ad290aee-7c8b-4e1e-beaa-3f9721e709be-kube-api-access-rk8zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dncwp\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.165861 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.165819    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad290aee-7c8b-4e1e-beaa-3f9721e709be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dncwp\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.174181 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.174137    2581 generic.go:356] "Generic (PLEG): container finished" podID="70443f7d-6a04-404f-adda-8f29aa071267" containerID="ed745dbb4857a08b3383bde4fdf447b36748eefcb21a4b5e9e3ed47faeee53b2" exitCode=0
Jul 06 19:58:08.177424 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.177388    2581 generic.go:356] "Generic (PLEG): container finished" podID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" containerID="75863342d1873a6f017e3621df1ef73c714de8aec5b59131815534ff349cb8b3" exitCode=0
Jul 06 19:58:08.177607 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.177435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8zx\" (UniqueName: \"kubernetes.io/projected/ad290aee-7c8b-4e1e-beaa-3f9721e709be-kube-api-access-rk8zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dncwp\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.178083 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.178040    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hvhv\" (UniqueName: \"kubernetes.io/projected/b8896722-ae74-457e-a266-f68cf5618bba-kube-api-access-9hvhv\") pod \"limitador-operator-controller-manager-859d7b78bd-st6gw\" (UID: \"b8896722-ae74-457e-a266-f68cf5618bba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:08.229283 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.229250    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:08.231527 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.231493    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5slj8\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="70443f7d-6a04-404f-adda-8f29aa071267" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:08.236072 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.236043    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:08.242311 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.242282    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:08.244795 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.244766    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9j4\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:08.246624 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:08.246597    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5slj8\" is forbidden: User \"system:node:ip-10-0-142-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-134.ec2.internal' and this object" podUID="70443f7d-6a04-404f-adda-8f29aa071267" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:08.265708 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.265677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrhq6\" (UniqueName: \"kubernetes.io/projected/70443f7d-6a04-404f-adda-8f29aa071267-kube-api-access-vrhq6\") pod \"70443f7d-6a04-404f-adda-8f29aa071267\" (UID: \"70443f7d-6a04-404f-adda-8f29aa071267\") "
Jul 06 19:58:08.265856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.265728    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5682d44c-b185-4e8b-8956-e7b213a2b5ad-extensions-socket-volume\") pod \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") "
Jul 06 19:58:08.265856 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.265753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntpfh\" (UniqueName: \"kubernetes.io/projected/5682d44c-b185-4e8b-8956-e7b213a2b5ad-kube-api-access-ntpfh\") pod \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\" (UID: \"5682d44c-b185-4e8b-8956-e7b213a2b5ad\") "
Jul 06 19:58:08.266120 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.266095    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5682d44c-b185-4e8b-8956-e7b213a2b5ad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5682d44c-b185-4e8b-8956-e7b213a2b5ad" (UID: "5682d44c-b185-4e8b-8956-e7b213a2b5ad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:08.268008 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.267984    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5682d44c-b185-4e8b-8956-e7b213a2b5ad-kube-api-access-ntpfh" (OuterVolumeSpecName: "kube-api-access-ntpfh") pod "5682d44c-b185-4e8b-8956-e7b213a2b5ad" (UID: "5682d44c-b185-4e8b-8956-e7b213a2b5ad"). InnerVolumeSpecName "kube-api-access-ntpfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:08.268076 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.268016    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70443f7d-6a04-404f-adda-8f29aa071267-kube-api-access-vrhq6" (OuterVolumeSpecName: "kube-api-access-vrhq6") pod "70443f7d-6a04-404f-adda-8f29aa071267" (UID: "70443f7d-6a04-404f-adda-8f29aa071267"). InnerVolumeSpecName "kube-api-access-vrhq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:08.366314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.366279    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrhq6\" (UniqueName: \"kubernetes.io/projected/70443f7d-6a04-404f-adda-8f29aa071267-kube-api-access-vrhq6\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:58:08.366314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.366307    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5682d44c-b185-4e8b-8956-e7b213a2b5ad-extensions-socket-volume\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:58:08.366314 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.366317    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntpfh\" (UniqueName: \"kubernetes.io/projected/5682d44c-b185-4e8b-8956-e7b213a2b5ad-kube-api-access-ntpfh\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:58:08.369167 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.369138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:08.376195 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.376166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:08.537188 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.537158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"]
Jul 06 19:58:08.538884 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:58:08.538855    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad290aee_7c8b_4e1e_beaa_3f9721e709be.slice/crio-747ab11dc65a5e395e38311f18323148e58d6664463899f4373d03aa8afdc978 WatchSource:0}: Error finding container 747ab11dc65a5e395e38311f18323148e58d6664463899f4373d03aa8afdc978: Status 404 returned error can't find the container with id 747ab11dc65a5e395e38311f18323148e58d6664463899f4373d03aa8afdc978
Jul 06 19:58:08.560869 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.560845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"]
Jul 06 19:58:08.563725 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:58:08.563679    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8896722_ae74_457e_a266_f68cf5618bba.slice/crio-a4ae1c4cc995b43c4e0b3bfd8190029cbe696518805846c9b8749d3caa8c3fc6 WatchSource:0}: Error finding container a4ae1c4cc995b43c4e0b3bfd8190029cbe696518805846c9b8749d3caa8c3fc6: Status 404 returned error can't find the container with id a4ae1c4cc995b43c4e0b3bfd8190029cbe696518805846c9b8749d3caa8c3fc6
Jul 06 19:58:08.682817 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.682777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:08.854065 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:08.854023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:09.025196 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.025165    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5682d44c-b185-4e8b-8956-e7b213a2b5ad" path="/var/lib/kubelet/pods/5682d44c-b185-4e8b-8956-e7b213a2b5ad/volumes"
Jul 06 19:58:09.025589 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.025512    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70443f7d-6a04-404f-adda-8f29aa071267" path="/var/lib/kubelet/pods/70443f7d-6a04-404f-adda-8f29aa071267/volumes"
Jul 06 19:58:09.060163 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.060116    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8" podUID="70443f7d-6a04-404f-adda-8f29aa071267" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.39:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:58:09.183964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.183868    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9j4"
Jul 06 19:58:09.183964 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.183931    2581 scope.go:117] "RemoveContainer" containerID="75863342d1873a6f017e3621df1ef73c714de8aec5b59131815534ff349cb8b3"
Jul 06 19:58:09.185831 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.185802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw" event={"ID":"b8896722-ae74-457e-a266-f68cf5618bba","Type":"ContainerStarted","Data":"63442434b95d034b646571137fbf5625437e77cf849c54b278f03765da5f6b52"}
Jul 06 19:58:09.185977 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.185862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw" event={"ID":"b8896722-ae74-457e-a266-f68cf5618bba","Type":"ContainerStarted","Data":"a4ae1c4cc995b43c4e0b3bfd8190029cbe696518805846c9b8749d3caa8c3fc6"}
Jul 06 19:58:09.185977 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.185948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:09.187848 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.187822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp" event={"ID":"ad290aee-7c8b-4e1e-beaa-3f9721e709be","Type":"ContainerStarted","Data":"129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369"}
Jul 06 19:58:09.187955 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.187868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp" event={"ID":"ad290aee-7c8b-4e1e-beaa-3f9721e709be","Type":"ContainerStarted","Data":"747ab11dc65a5e395e38311f18323148e58d6664463899f4373d03aa8afdc978"}
Jul 06 19:58:09.187955 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.187888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:09.189218 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.189198    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5slj8"
Jul 06 19:58:09.193998 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.193982    2581 scope.go:117] "RemoveContainer" containerID="ed745dbb4857a08b3383bde4fdf447b36748eefcb21a4b5e9e3ed47faeee53b2"
Jul 06 19:58:09.210024 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.209973    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw" podStartSLOduration=2.209954122 podStartE2EDuration="2.209954122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:09.208566475 +0000 UTC m=+428.592225238" watchObservedRunningTime="2026-07-06 19:58:09.209954122 +0000 UTC m=+428.593612930"
Jul 06 19:58:09.234476 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.234420    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp" podStartSLOduration=2.2344017369999998 podStartE2EDuration="2.234401737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:09.233061907 +0000 UTC m=+428.616720658" watchObservedRunningTime="2026-07-06 19:58:09.234401737 +0000 UTC m=+428.618060487"
Jul 06 19:58:09.246769 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.246731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:09.329236 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:09.329200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:11.630823 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:11.630778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:11.730628 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:11.730594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:16.888285 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:16.888250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:16.999705 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:16.999671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:19.481940 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:19.481890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:19.616022 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:19.615981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:20.200333 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:20.200305    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 19:58:20.200565 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:20.200419    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:24.004079 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.003998    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"]
Jul 06 19:58:24.004496 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.004246    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp" podUID="ad290aee-7c8b-4e1e-beaa-3f9721e709be" containerName="manager" containerID="cri-o://129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369" gracePeriod=10
Jul 06 19:58:24.265105 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.265037    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:24.272884 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.272851    2581 generic.go:356] "Generic (PLEG): container finished" podID="ad290aee-7c8b-4e1e-beaa-3f9721e709be" containerID="129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369" exitCode=0
Jul 06 19:58:24.273034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.272894    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"
Jul 06 19:58:24.273034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.272937    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp" event={"ID":"ad290aee-7c8b-4e1e-beaa-3f9721e709be","Type":"ContainerDied","Data":"129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369"}
Jul 06 19:58:24.273034 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.273008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp" event={"ID":"ad290aee-7c8b-4e1e-beaa-3f9721e709be","Type":"ContainerDied","Data":"747ab11dc65a5e395e38311f18323148e58d6664463899f4373d03aa8afdc978"}
Jul 06 19:58:24.273210 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.273045    2581 scope.go:117] "RemoveContainer" containerID="129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369"
Jul 06 19:58:24.276202 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.276181    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"]
Jul 06 19:58:24.276567 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.276553    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad290aee-7c8b-4e1e-beaa-3f9721e709be" containerName="manager"
Jul 06 19:58:24.276567 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.276566    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad290aee-7c8b-4e1e-beaa-3f9721e709be" containerName="manager"
Jul 06 19:58:24.276707 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.276646    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad290aee-7c8b-4e1e-beaa-3f9721e709be" containerName="manager"
Jul 06 19:58:24.279685 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.279668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.282760 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.282741    2581 scope.go:117] "RemoveContainer" containerID="129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369"
Jul 06 19:58:24.283056 ip-10-0-142-134 kubenswrapper[2581]: E0706 19:58:24.283039    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369\": container with ID starting with 129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369 not found: ID does not exist" containerID="129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369"
Jul 06 19:58:24.283103 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.283066    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369"} err="failed to get container status \"129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369\": rpc error: code = NotFound desc = could not find container \"129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369\": container with ID starting with 129f317e8c37e13d74115f571a245224ca350d6f6feb699300c588158af08369 not found: ID does not exist"
Jul 06 19:58:24.299642 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.299615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"]
Jul 06 19:58:24.411137 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.411105    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk8zx\" (UniqueName: \"kubernetes.io/projected/ad290aee-7c8b-4e1e-beaa-3f9721e709be-kube-api-access-rk8zx\") pod \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") "
Jul 06 19:58:24.411311 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.411204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad290aee-7c8b-4e1e-beaa-3f9721e709be-extensions-socket-volume\") pod \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\" (UID: \"ad290aee-7c8b-4e1e-beaa-3f9721e709be\") "
Jul 06 19:58:24.411357 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.411313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2114be-01e3-4c22-807f-511f97d1b65b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-85hwx\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.411357 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.411341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gf7\" (UniqueName: \"kubernetes.io/projected/6a2114be-01e3-4c22-807f-511f97d1b65b-kube-api-access-r7gf7\") pod \"kuadrant-operator-controller-manager-86878c769f-85hwx\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.411643 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.411619    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad290aee-7c8b-4e1e-beaa-3f9721e709be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ad290aee-7c8b-4e1e-beaa-3f9721e709be" (UID: "ad290aee-7c8b-4e1e-beaa-3f9721e709be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:24.413421 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.413397    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad290aee-7c8b-4e1e-beaa-3f9721e709be-kube-api-access-rk8zx" (OuterVolumeSpecName: "kube-api-access-rk8zx") pod "ad290aee-7c8b-4e1e-beaa-3f9721e709be" (UID: "ad290aee-7c8b-4e1e-beaa-3f9721e709be"). InnerVolumeSpecName "kube-api-access-rk8zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:24.512494 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.512450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2114be-01e3-4c22-807f-511f97d1b65b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-85hwx\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.512690 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.512509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gf7\" (UniqueName: \"kubernetes.io/projected/6a2114be-01e3-4c22-807f-511f97d1b65b-kube-api-access-r7gf7\") pod \"kuadrant-operator-controller-manager-86878c769f-85hwx\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.512690 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.512590    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad290aee-7c8b-4e1e-beaa-3f9721e709be-extensions-socket-volume\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:58:24.512690 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.512605    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk8zx\" (UniqueName: \"kubernetes.io/projected/ad290aee-7c8b-4e1e-beaa-3f9721e709be-kube-api-access-rk8zx\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 19:58:24.512850 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.512827    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2114be-01e3-4c22-807f-511f97d1b65b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-85hwx\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.544758 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.544694    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gf7\" (UniqueName: \"kubernetes.io/projected/6a2114be-01e3-4c22-807f-511f97d1b65b-kube-api-access-r7gf7\") pod \"kuadrant-operator-controller-manager-86878c769f-85hwx\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.589528 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.589502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:24.600440 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.600415    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"]
Jul 06 19:58:24.608336 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.608307    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dncwp"]
Jul 06 19:58:24.735932 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:24.735894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"]
Jul 06 19:58:24.739140 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:58:24.739113    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2114be_01e3_4c22_807f_511f97d1b65b.slice/crio-dde7a2458e16eb4ad03d626b22cc0c69aedb14613cdc3150d23d282d25db91cf WatchSource:0}: Error finding container dde7a2458e16eb4ad03d626b22cc0c69aedb14613cdc3150d23d282d25db91cf: Status 404 returned error can't find the container with id dde7a2458e16eb4ad03d626b22cc0c69aedb14613cdc3150d23d282d25db91cf
Jul 06 19:58:25.024540 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:25.024506    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad290aee-7c8b-4e1e-beaa-3f9721e709be" path="/var/lib/kubelet/pods/ad290aee-7c8b-4e1e-beaa-3f9721e709be/volumes"
Jul 06 19:58:25.282404 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:25.282297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" event={"ID":"6a2114be-01e3-4c22-807f-511f97d1b65b","Type":"ContainerStarted","Data":"e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"}
Jul 06 19:58:25.282404 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:25.282346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" event={"ID":"6a2114be-01e3-4c22-807f-511f97d1b65b","Type":"ContainerStarted","Data":"dde7a2458e16eb4ad03d626b22cc0c69aedb14613cdc3150d23d282d25db91cf"}
Jul 06 19:58:25.282616 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:25.282420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:25.310436 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:25.310386    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" podStartSLOduration=1.310352981 podStartE2EDuration="1.310352981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:25.307873495 +0000 UTC m=+444.691532245" watchObservedRunningTime="2026-07-06 19:58:25.310352981 +0000 UTC m=+444.694011730"
Jul 06 19:58:36.290530 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:36.290493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 19:58:40.439578 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.439540    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"]
Jul 06 19:58:40.444982 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.444962    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.447202 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.447180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5zsjw\""
Jul 06 19:58:40.454686 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.454662    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"]
Jul 06 19:58:40.471097 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.471062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:40.550940 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.550908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:40.559921 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.559891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560046 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.559933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/932037f1-5834-45ab-a761-4dea76f922f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560046 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.559958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/932037f1-5834-45ab-a761-4dea76f922f1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560046 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.559981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr57x\" (UniqueName: \"kubernetes.io/projected/932037f1-5834-45ab-a761-4dea76f922f1-kube-api-access-xr57x\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560159 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.560050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560159 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.560065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/932037f1-5834-45ab-a761-4dea76f922f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560159 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.560084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560159 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.560104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.560159 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.560130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661052 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.660992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/932037f1-5834-45ab-a761-4dea76f922f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661052 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/932037f1-5834-45ab-a761-4dea76f922f1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr57x\" (UniqueName: \"kubernetes.io/projected/932037f1-5834-45ab-a761-4dea76f922f1-kube-api-access-xr57x\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/932037f1-5834-45ab-a761-4dea76f922f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661749 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661613    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661749 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661651    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661874    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.661988 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.661984    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/932037f1-5834-45ab-a761-4dea76f922f1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.663708 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.663689    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/932037f1-5834-45ab-a761-4dea76f922f1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.663802 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.663763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/932037f1-5834-45ab-a761-4dea76f922f1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.670407 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.670343    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/932037f1-5834-45ab-a761-4dea76f922f1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.670534 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.670480    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr57x\" (UniqueName: \"kubernetes.io/projected/932037f1-5834-45ab-a761-4dea76f922f1-kube-api-access-xr57x\") pod \"maas-default-gateway-openshift-default-56654dcf7-njvch\" (UID: \"932037f1-5834-45ab-a761-4dea76f922f1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.756102 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.755996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:40.914708 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:58:40.914675    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932037f1_5834_45ab_a761_4dea76f922f1.slice/crio-ef824e9c7d7ccef82062b3486f0c0a150d023c531e4b784b58aea436d4a5dc95 WatchSource:0}: Error finding container ef824e9c7d7ccef82062b3486f0c0a150d023c531e4b784b58aea436d4a5dc95: Status 404 returned error can't find the container with id ef824e9c7d7ccef82062b3486f0c0a150d023c531e4b784b58aea436d4a5dc95
Jul 06 19:58:40.915414 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.915393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"]
Jul 06 19:58:40.916743 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.916715    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:58:40.916841 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.916797    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:58:40.916841 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:40.916829    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 19:58:41.370993 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:41.370955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" event={"ID":"932037f1-5834-45ab-a761-4dea76f922f1","Type":"ContainerStarted","Data":"529cf1364292b684b553835215becfa17cf69873688a05292119130620462936"}
Jul 06 19:58:41.371207 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:41.371012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" event={"ID":"932037f1-5834-45ab-a761-4dea76f922f1","Type":"ContainerStarted","Data":"ef824e9c7d7ccef82062b3486f0c0a150d023c531e4b784b58aea436d4a5dc95"}
Jul 06 19:58:41.390882 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:41.390829    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" podStartSLOduration=1.390813932 podStartE2EDuration="1.390813932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:41.389908865 +0000 UTC m=+460.773567615" watchObservedRunningTime="2026-07-06 19:58:41.390813932 +0000 UTC m=+460.774472680"
Jul 06 19:58:41.756551 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:41.756453    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:41.761378 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:41.761331    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:42.377024 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:42.376998    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:42.378084 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:42.378066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 19:58:55.329852 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.329815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:55.447775 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.447729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:55.525279 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.525236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:55.827789 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.827752    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 19:58:55.831447 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.831423    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:55.833516 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.833495    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:58:55.833696 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.833570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s7x4d\""
Jul 06 19:58:55.841653 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.841627    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 19:58:55.876158 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.876124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 19:58:55.897051 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.897009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb2eff6a-f1ba-4c1f-b658-e89ca05d48be-config-file\") pod \"limitador-limitador-54d6d988d5-j5wb5\" (UID: \"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:55.897230 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.897123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvls7\" (UniqueName: \"kubernetes.io/projected/fb2eff6a-f1ba-4c1f-b658-e89ca05d48be-kube-api-access-kvls7\") pod \"limitador-limitador-54d6d988d5-j5wb5\" (UID: \"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:55.997801 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.997760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvls7\" (UniqueName: \"kubernetes.io/projected/fb2eff6a-f1ba-4c1f-b658-e89ca05d48be-kube-api-access-kvls7\") pod \"limitador-limitador-54d6d988d5-j5wb5\" (UID: \"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:55.997980 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.997849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb2eff6a-f1ba-4c1f-b658-e89ca05d48be-config-file\") pod \"limitador-limitador-54d6d988d5-j5wb5\" (UID: \"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:55.998553 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:55.998536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb2eff6a-f1ba-4c1f-b658-e89ca05d48be-config-file\") pod \"limitador-limitador-54d6d988d5-j5wb5\" (UID: \"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:56.011058 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.011022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvls7\" (UniqueName: \"kubernetes.io/projected/fb2eff6a-f1ba-4c1f-b658-e89ca05d48be-kube-api-access-kvls7\") pod \"limitador-limitador-54d6d988d5-j5wb5\" (UID: \"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:56.143274 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.143193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:56.200435 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.199678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:56.272355 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.272310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:56.288983 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.288961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 19:58:56.291474 ip-10-0-142-134 kubenswrapper[2581]: W0706 19:58:56.291438    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2eff6a_f1ba_4c1f_b658_e89ca05d48be.slice/crio-40dadb655c2d33cdfcb472fa13be2df31833a03fd73b947943a5bb8212de3ac6 WatchSource:0}: Error finding container 40dadb655c2d33cdfcb472fa13be2df31833a03fd73b947943a5bb8212de3ac6: Status 404 returned error can't find the container with id 40dadb655c2d33cdfcb472fa13be2df31833a03fd73b947943a5bb8212de3ac6
Jul 06 19:58:56.346659 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.346617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:56.454000 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:56.453922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5" event={"ID":"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be","Type":"ContainerStarted","Data":"40dadb655c2d33cdfcb472fa13be2df31833a03fd73b947943a5bb8212de3ac6"}
Jul 06 19:58:59.471459 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:59.471415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5" event={"ID":"fb2eff6a-f1ba-4c1f-b658-e89ca05d48be","Type":"ContainerStarted","Data":"b4f0cf51acc009f1140b1dce0dc8a04982292d17e5be048959e2835717e5e521"}
Jul 06 19:58:59.471893 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:59.471521    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:58:59.493382 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:58:59.493311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5" podStartSLOduration=2.038088879 podStartE2EDuration="4.493295755s" totalImagesPullingTime="2.455206876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:59.491471474 +0000 UTC m=+478.875130278" watchObservedRunningTime="2026-07-06 19:58:59.493295755 +0000 UTC m=+478.876954504"
Jul 06 19:59:10.478316 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:10.478288    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"
Jul 06 19:59:14.282933 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:14.282894    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.545948 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:28.545910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.631094 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:28.631062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:33.617588 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:33.617557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:33.875267 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:33.875165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:40.549274 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:40.549228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:40.643342 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:40.643308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:40.739088 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:40.739048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:40.948667 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:40.948543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:43.645263 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:43.645231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:43.759158 ip-10-0-142-134 kubenswrapper[2581]: I0706 19:59:43.759115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:15.272067 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:15.271973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:15.849702 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:15.849662    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:16.130216 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:16.130120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:16.484531 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:16.484429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:16.578250 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:16.578215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:16.664324 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:16.664290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:00:23.927997 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:23.927966    2581 generic.go:356] "Generic (PLEG): container finished" podID="932037f1-5834-45ab-a761-4dea76f922f1" containerID="529cf1364292b684b553835215becfa17cf69873688a05292119130620462936" exitCode=0
Jul 06 20:00:23.928457 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:23.928036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" event={"ID":"932037f1-5834-45ab-a761-4dea76f922f1","Type":"ContainerDied","Data":"529cf1364292b684b553835215becfa17cf69873688a05292119130620462936"}
Jul 06 20:00:23.928510 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:23.928493    2581 scope.go:117] "RemoveContainer" containerID="529cf1364292b684b553835215becfa17cf69873688a05292119130620462936"
Jul 06 20:00:23.929498 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:23.929464    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:00:23.929596 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:23.929541    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:00:23.929596 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:23.929577    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:00:24.936565 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:24.936529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" event={"ID":"932037f1-5834-45ab-a761-4dea76f922f1","Type":"ContainerStarted","Data":"4d892b8632ffdfc2ea9a234ea640120abf536ece803dfc7b48ec7b3d9a9dc2c3"}
Jul 06 20:00:25.756792 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:25.756745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 20:00:25.758189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:25.758162    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njvch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:00:25.758297 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:25.758214    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" podUID="932037f1-5834-45ab-a761-4dea76f922f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 20:00:26.521087 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:26.521047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:26.610224 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:26.610195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:26.757103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:26.757066    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njvch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:00:26.757295 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:26.757131    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" podUID="932037f1-5834-45ab-a761-4dea76f922f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 20:00:27.377263 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:27.377213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 20:00:27.756744 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:27.756658    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njvch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:00:27.756744 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:27.756723    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" podUID="932037f1-5834-45ab-a761-4dea76f922f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 20:00:28.756878 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:28.756845    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-njvch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:00:28.757290 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:28.756913    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch" podUID="932037f1-5834-45ab-a761-4dea76f922f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 20:00:29.760743 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:29.760709    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 20:00:29.761760 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:29.761742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-njvch"
Jul 06 20:00:31.333078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:31.333007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:31.840789 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:00:31.840753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:01:00.971262 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:00.971229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:01:00.971879 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:00.971494    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:01:03.158624 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:03.158576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:03.753602 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:03.753565    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:01:15.702490 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:15.702457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:16.748722 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:16.748686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:01:23.479416 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:23.479296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:24.956445 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:24.956406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:01:25.331159 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:25.331126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:26.600527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:26.600476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:31.482095 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:31.482057    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:01:36.437409 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:36.437337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:39.850143 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:01:39.850108    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:02:17.006090 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:17.006053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:17.207560 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:17.207518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:18.241800 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:18.241759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:18.336087 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:18.336040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.229971 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:24.229935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.333238 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:24.333202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:29.874456 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:29.874417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:30.004431 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:30.004392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:42.675601 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.675561    2581 generic.go:356] "Generic (PLEG): container finished" podID="156198ce-4a5d-425e-8a60-7e04d566a21e" containerID="d2cb47a544726fb35dd14fc697bbf8ba3c917569e0f690ea456329440d0ce669" exitCode=1
Jul 06 20:02:42.676007 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.675634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc" event={"ID":"156198ce-4a5d-425e-8a60-7e04d566a21e","Type":"ContainerDied","Data":"d2cb47a544726fb35dd14fc697bbf8ba3c917569e0f690ea456329440d0ce669"}
Jul 06 20:02:42.676077 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.676061    2581 scope.go:117] "RemoveContainer" containerID="d2cb47a544726fb35dd14fc697bbf8ba3c917569e0f690ea456329440d0ce669"
Jul 06 20:02:42.676462 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.676439    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:02:42.677391 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.677373    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8896722-ae74-457e-a266-f68cf5618bba" containerID="63442434b95d034b646571137fbf5625437e77cf849c54b278f03765da5f6b52" exitCode=1
Jul 06 20:02:42.677475 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.677402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw" event={"ID":"b8896722-ae74-457e-a266-f68cf5618bba","Type":"ContainerDied","Data":"63442434b95d034b646571137fbf5625437e77cf849c54b278f03765da5f6b52"}
Jul 06 20:02:42.677698 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.677681    2581 scope.go:117] "RemoveContainer" containerID="63442434b95d034b646571137fbf5625437e77cf849c54b278f03765da5f6b52"
Jul 06 20:02:42.679246 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.679223    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerID="e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036" exitCode=0
Jul 06 20:02:42.679340 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.679294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" event={"ID":"6a2114be-01e3-4c22-807f-511f97d1b65b","Type":"ContainerDied","Data":"e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"}
Jul 06 20:02:42.679648 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.679597    2581 scope.go:117] "RemoveContainer" containerID="e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"
Jul 06 20:02:42.681004 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.680982    2581 generic.go:356] "Generic (PLEG): container finished" podID="5644e8a4-0902-4360-b2a9-80d8ec61c0c5" containerID="4e0283623e566090e5ff609a154e8600aef7e2fe2e6e8d9bdce6a8a7a6d10b90" exitCode=1
Jul 06 20:02:42.681079 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.681048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2" event={"ID":"5644e8a4-0902-4360-b2a9-80d8ec61c0c5","Type":"ContainerDied","Data":"4e0283623e566090e5ff609a154e8600aef7e2fe2e6e8d9bdce6a8a7a6d10b90"}
Jul 06 20:02:42.681332 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:42.681303    2581 scope.go:117] "RemoveContainer" containerID="4e0283623e566090e5ff609a154e8600aef7e2fe2e6e8d9bdce6a8a7a6d10b90"
Jul 06 20:02:43.386744 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.386648    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 20:02:43.403137 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.403107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 20:02:43.689155 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.689046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc" event={"ID":"156198ce-4a5d-425e-8a60-7e04d566a21e","Type":"ContainerStarted","Data":"2452e80b4fe9bdf312ba4134c00954be969d1a067edfcd304e8865006041cfbb"}
Jul 06 20:02:43.689644 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.689179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 20:02:43.690692 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.690670    2581 generic.go:356] "Generic (PLEG): container finished" podID="c331061b-5c62-42c8-bc60-3a80df948771" containerID="b8a29521db9e95bad8dc394f741b54df66d41b204cab14ea66c78b82a20be779" exitCode=1
Jul 06 20:02:43.690786 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.690739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj" event={"ID":"c331061b-5c62-42c8-bc60-3a80df948771","Type":"ContainerDied","Data":"b8a29521db9e95bad8dc394f741b54df66d41b204cab14ea66c78b82a20be779"}
Jul 06 20:02:43.695397 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.691593    2581 scope.go:117] "RemoveContainer" containerID="b8a29521db9e95bad8dc394f741b54df66d41b204cab14ea66c78b82a20be779"
Jul 06 20:02:43.699673 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.699646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw" event={"ID":"b8896722-ae74-457e-a266-f68cf5618bba","Type":"ContainerStarted","Data":"638188e0e8dfdd4a072bf166f8cd88f96e8251f28663482ed1661aced554e168"}
Jul 06 20:02:43.699965 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.699944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 20:02:43.701893 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.701873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" event={"ID":"6a2114be-01e3-4c22-807f-511f97d1b65b","Type":"ContainerStarted","Data":"70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae"}
Jul 06 20:02:43.702101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.702086    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 20:02:43.703801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.703780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2" event={"ID":"5644e8a4-0902-4360-b2a9-80d8ec61c0c5","Type":"ContainerStarted","Data":"d8256843419b50fba84717dea1b88cdf4ea56f1df7a0c01ba5034506d80ca445"}
Jul 06 20:02:43.703922 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.703908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 20:02:43.705484 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.705456    2581 generic.go:356] "Generic (PLEG): container finished" podID="7d5e6e05-6fbd-4411-960b-98727841f5a0" containerID="67ebf37cf6ad9d9fc3f922a35b9ffb7f88ed5766ddbb62c372b24108b12213c8" exitCode=1
Jul 06 20:02:43.705574 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.705530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl" event={"ID":"7d5e6e05-6fbd-4411-960b-98727841f5a0","Type":"ContainerDied","Data":"67ebf37cf6ad9d9fc3f922a35b9ffb7f88ed5766ddbb62c372b24108b12213c8"}
Jul 06 20:02:43.705887 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:43.705875    2581 scope.go:117] "RemoveContainer" containerID="67ebf37cf6ad9d9fc3f922a35b9ffb7f88ed5766ddbb62c372b24108b12213c8"
Jul 06 20:02:44.713961 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:44.713927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl" event={"ID":"7d5e6e05-6fbd-4411-960b-98727841f5a0","Type":"ContainerStarted","Data":"49e434b1a2ea5184c57291bb4587b04c35d9217e15fda11cfa3c8c11c0b12017"}
Jul 06 20:02:44.714454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:44.714160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 20:02:44.715933 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:44.715905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj" event={"ID":"c331061b-5c62-42c8-bc60-3a80df948771","Type":"ContainerStarted","Data":"afbd6376507f3514154b035329a6161e0b20e75573a6ebc0b7c63fc7db2fbce7"}
Jul 06 20:02:44.716524 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:44.716505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 20:02:45.466844 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:02:45.466799    2581 controller.go:195] "Failed to update lease" err="Put \"https://a6db7a207d6b64e36a873df556a38fb3-1416a23d8811a43b.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-142-134.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 20:02:50.573147 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:02:50.573113    2581 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-142-134.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Jul 06 20:02:50.630185 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:50.630144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:50.805263 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:50.805228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:51.404618 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:51.404526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:51.647527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:51.647489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:54.718827 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:54.718787    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st6gw"
Jul 06 20:02:54.719235 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:54.718989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 20:02:55.723919 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:55.723887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g5vkl"
Jul 06 20:02:55.724391 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:02:55.723968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf6wj"
Jul 06 20:03:14.717667 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:14.717636    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tvrs2"
Jul 06 20:03:14.720747 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:14.720722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-679cc"
Jul 06 20:03:16.405230 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:16.405161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:18.059443 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:18.059411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:03:18.404247 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:18.404166    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d54484f59-2w878"]
Jul 06 20:03:18.615212 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:18.615178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:18.744696 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:18.744581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:28.142450 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:28.142411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:03:37.643398 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:37.643330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:03:43.431079 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.431016    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d54484f59-2w878" podUID="00937ce4-fd4f-45d1-b2bd-d14d7187c241" containerName="console" containerID="cri-o://e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5" gracePeriod=15
Jul 06 20:03:43.692098 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.692026    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 20:03:43.769566 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-service-ca\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.769764 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769577    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jm78\" (UniqueName: \"kubernetes.io/projected/00937ce4-fd4f-45d1-b2bd-d14d7187c241-kube-api-access-4jm78\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.769764 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-oauth-serving-cert\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.769764 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-config\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.769764 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769698    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-serving-cert\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.769989 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-trusted-ca-bundle\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.769989 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.769895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-oauth-config\") pod \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\" (UID: \"00937ce4-fd4f-45d1-b2bd-d14d7187c241\") "
Jul 06 20:03:43.770098 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770013    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-service-ca" (OuterVolumeSpecName: "service-ca") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:03:43.770098 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770069    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:03:43.770187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770116    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-config" (OuterVolumeSpecName: "console-config") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:03:43.770403 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770353    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:03:43.770478 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770378    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-service-ca\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:43.770478 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770426    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-oauth-serving-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:43.770478 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.770440    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-config\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:43.772097 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.772065    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:03:43.772097 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.772067    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00937ce4-fd4f-45d1-b2bd-d14d7187c241-kube-api-access-4jm78" (OuterVolumeSpecName: "kube-api-access-4jm78") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "kube-api-access-4jm78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:03:43.772236 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.772208    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00937ce4-fd4f-45d1-b2bd-d14d7187c241" (UID: "00937ce4-fd4f-45d1-b2bd-d14d7187c241"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:03:43.870919 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.870872    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-serving-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:43.870919 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.870912    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00937ce4-fd4f-45d1-b2bd-d14d7187c241-trusted-ca-bundle\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:43.870919 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.870921    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00937ce4-fd4f-45d1-b2bd-d14d7187c241-console-oauth-config\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:43.871166 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:43.870932    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jm78\" (UniqueName: \"kubernetes.io/projected/00937ce4-fd4f-45d1-b2bd-d14d7187c241-kube-api-access-4jm78\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:03:44.040967 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.040871    2581 generic.go:356] "Generic (PLEG): container finished" podID="00937ce4-fd4f-45d1-b2bd-d14d7187c241" containerID="e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5" exitCode=0
Jul 06 20:03:44.040967 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.040924    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d54484f59-2w878"
Jul 06 20:03:44.041197 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.040964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d54484f59-2w878" event={"ID":"00937ce4-fd4f-45d1-b2bd-d14d7187c241","Type":"ContainerDied","Data":"e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5"}
Jul 06 20:03:44.041197 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.041027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d54484f59-2w878" event={"ID":"00937ce4-fd4f-45d1-b2bd-d14d7187c241","Type":"ContainerDied","Data":"c17d4ab4830220229398c5fe6d38efb743762fb94340bdba80001505701e1af7"}
Jul 06 20:03:44.041197 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.041055    2581 scope.go:117] "RemoveContainer" containerID="e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5"
Jul 06 20:03:44.051288 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.051267    2581 scope.go:117] "RemoveContainer" containerID="e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5"
Jul 06 20:03:44.051640 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:03:44.051617    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5\": container with ID starting with e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5 not found: ID does not exist" containerID="e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5"
Jul 06 20:03:44.051739 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.051645    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5"} err="failed to get container status \"e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5\": rpc error: code = NotFound desc = could not find container \"e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5\": container with ID starting with e099192d694eb14bb5eda645ec85f6570e934c445a4871a9c102c6d5cee8a8f5 not found: ID does not exist"
Jul 06 20:03:44.063151 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.063122    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d54484f59-2w878"]
Jul 06 20:03:44.070901 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:44.070878    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d54484f59-2w878"]
Jul 06 20:03:45.024654 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:45.024620    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00937ce4-fd4f-45d1-b2bd-d14d7187c241" path="/var/lib/kubelet/pods/00937ce4-fd4f-45d1-b2bd-d14d7187c241/volumes"
Jul 06 20:03:47.539866 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:47.539826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:03:57.732081 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:03:57.732043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:04:00.261942 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:00.261902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:02.243319 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:02.243276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:04.542263 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:04.542218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:26.251598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:26.251514    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:04:41.745280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:41.745246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:04:44.209660 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:44.209614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:44.331959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:44.331913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:44.505064 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:44.504960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:51.135138 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:51.135102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:51.431824 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:51.431736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:51.664092 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:51.664059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:51.813595 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:51.813537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:58.164646 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:58.164608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:58.342036 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:04:58.342003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:06.955901 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:06.955859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:07.026169 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:07.026128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:17.666490 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:17.666453    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:05:25.170617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:25.170580    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:05:35.550988 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:35.550951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:05:41.276625 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:41.276586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:05:52.577228 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:05:52.577141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:06:01.003711 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:01.003682    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:06:01.005008 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:01.004987    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:06:02.147280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:02.147245    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:06:13.924119 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:13.924071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:06:20.515305 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:20.515271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:06:27.687373 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:27.687334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:06:36.654875 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:36.654840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:06:49.032863 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:06:49.032832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:07:00.173082 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:07:00.173038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:07:26.555560 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:07:26.555465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:07:37.657574 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:07:37.657541    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:07:53.976379 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:07:53.976311    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:08:03.252906 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:08:03.252867    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:08:12.661457 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:08:12.661412    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:08:21.658928 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:08:21.658892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:08:31.445629 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:08:31.445592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:08:51.462266 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:08:51.462185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:52.699791 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:08:52.699746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:01.424960 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:01.424925    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"]
Jul 06 20:09:01.425382 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:01.425119    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager" containerID="cri-o://70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae" gracePeriod=10
Jul 06 20:09:04.492479 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.492449    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 20:09:04.611249 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.611214    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2114be-01e3-4c22-807f-511f97d1b65b-extensions-socket-volume\") pod \"6a2114be-01e3-4c22-807f-511f97d1b65b\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") "
Jul 06 20:09:04.611458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.611268    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7gf7\" (UniqueName: \"kubernetes.io/projected/6a2114be-01e3-4c22-807f-511f97d1b65b-kube-api-access-r7gf7\") pod \"6a2114be-01e3-4c22-807f-511f97d1b65b\" (UID: \"6a2114be-01e3-4c22-807f-511f97d1b65b\") "
Jul 06 20:09:04.611705 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.611677    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2114be-01e3-4c22-807f-511f97d1b65b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a2114be-01e3-4c22-807f-511f97d1b65b" (UID: "6a2114be-01e3-4c22-807f-511f97d1b65b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:04.613655 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.613632    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a2114be-01e3-4c22-807f-511f97d1b65b-kube-api-access-r7gf7" (OuterVolumeSpecName: "kube-api-access-r7gf7") pod "6a2114be-01e3-4c22-807f-511f97d1b65b" (UID: "6a2114be-01e3-4c22-807f-511f97d1b65b"). InnerVolumeSpecName "kube-api-access-r7gf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:04.712822 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.712776    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2114be-01e3-4c22-807f-511f97d1b65b-extensions-socket-volume\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:09:04.712822 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.712816    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7gf7\" (UniqueName: \"kubernetes.io/projected/6a2114be-01e3-4c22-807f-511f97d1b65b-kube-api-access-r7gf7\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:09:04.762447 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.762408    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerID="70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae" exitCode=0
Jul 06 20:09:04.762652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.762462    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"
Jul 06 20:09:04.762652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.762500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" event={"ID":"6a2114be-01e3-4c22-807f-511f97d1b65b","Type":"ContainerDied","Data":"70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae"}
Jul 06 20:09:04.762652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.762563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx" event={"ID":"6a2114be-01e3-4c22-807f-511f97d1b65b","Type":"ContainerDied","Data":"dde7a2458e16eb4ad03d626b22cc0c69aedb14613cdc3150d23d282d25db91cf"}
Jul 06 20:09:04.762652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.762593    2581 scope.go:117] "RemoveContainer" containerID="70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae"
Jul 06 20:09:04.773198 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.773179    2581 scope.go:117] "RemoveContainer" containerID="e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"
Jul 06 20:09:04.781679 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.781653    2581 scope.go:117] "RemoveContainer" containerID="70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae"
Jul 06 20:09:04.781972 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:09:04.781947    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae\": container with ID starting with 70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae not found: ID does not exist" containerID="70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae"
Jul 06 20:09:04.782078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.781978    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae"} err="failed to get container status \"70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae\": rpc error: code = NotFound desc = could not find container \"70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae\": container with ID starting with 70b98498c288e84120e62f4b11dff1ea91f2fd94720e97889edcd86a6c9ff7ae not found: ID does not exist"
Jul 06 20:09:04.782078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.781995    2581 scope.go:117] "RemoveContainer" containerID="e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"
Jul 06 20:09:04.782226 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:09:04.782210    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036\": container with ID starting with e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036 not found: ID does not exist" containerID="e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"
Jul 06 20:09:04.782270 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.782231    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036"} err="failed to get container status \"e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036\": rpc error: code = NotFound desc = could not find container \"e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036\": container with ID starting with e74315e7ff65b0ff1343cf401f522e0aef2c5a4e1c914d89e24808e023f6b036 not found: ID does not exist"
Jul 06 20:09:04.802952 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.802914    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"]
Jul 06 20:09:04.809458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:04.809434    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85hwx"]
Jul 06 20:09:05.023935 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:09:05.023855    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" path="/var/lib/kubelet/pods/6a2114be-01e3-4c22-807f-511f97d1b65b/volumes"
Jul 06 20:10:02.566806 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.566759    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"]
Jul 06 20:10:02.567224 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567208    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00937ce4-fd4f-45d1-b2bd-d14d7187c241" containerName="console"
Jul 06 20:10:02.567271 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567228    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="00937ce4-fd4f-45d1-b2bd-d14d7187c241" containerName="console"
Jul 06 20:10:02.567271 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567247    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager"
Jul 06 20:10:02.567271 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567252    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager"
Jul 06 20:10:02.567271 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567259    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager"
Jul 06 20:10:02.567271 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567265    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager"
Jul 06 20:10:02.567465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567325    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager"
Jul 06 20:10:02.567465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.567338    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00937ce4-fd4f-45d1-b2bd-d14d7187c241" containerName="console"
Jul 06 20:10:02.570717 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.570699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.572994 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.572973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nsjzn\""
Jul 06 20:10:02.586502 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.586478    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"]
Jul 06 20:10:02.610650 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.610616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgwdz\" (UniqueName: \"kubernetes.io/projected/c0477dd0-101b-49e3-ba85-9dcd96aac44b-kube-api-access-zgwdz\") pod \"kuadrant-operator-controller-manager-86878c769f-pdw9w\" (UID: \"c0477dd0-101b-49e3-ba85-9dcd96aac44b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.610799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.610670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0477dd0-101b-49e3-ba85-9dcd96aac44b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pdw9w\" (UID: \"c0477dd0-101b-49e3-ba85-9dcd96aac44b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.711467 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.711420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgwdz\" (UniqueName: \"kubernetes.io/projected/c0477dd0-101b-49e3-ba85-9dcd96aac44b-kube-api-access-zgwdz\") pod \"kuadrant-operator-controller-manager-86878c769f-pdw9w\" (UID: \"c0477dd0-101b-49e3-ba85-9dcd96aac44b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.711638 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.711503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0477dd0-101b-49e3-ba85-9dcd96aac44b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pdw9w\" (UID: \"c0477dd0-101b-49e3-ba85-9dcd96aac44b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.711927 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.711907    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0477dd0-101b-49e3-ba85-9dcd96aac44b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pdw9w\" (UID: \"c0477dd0-101b-49e3-ba85-9dcd96aac44b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.722102 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.722078    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgwdz\" (UniqueName: \"kubernetes.io/projected/c0477dd0-101b-49e3-ba85-9dcd96aac44b-kube-api-access-zgwdz\") pod \"kuadrant-operator-controller-manager-86878c769f-pdw9w\" (UID: \"c0477dd0-101b-49e3-ba85-9dcd96aac44b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:02.881797 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:02.881702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:03.037274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:03.037251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"]
Jul 06 20:10:03.039955 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:10:03.039928    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0477dd0_101b_49e3_ba85_9dcd96aac44b.slice/crio-3b0506290585f6eb0bf5dd6c1847326a7c9c92213a8e5f1ec6e57ab1ef40db9c WatchSource:0}: Error finding container 3b0506290585f6eb0bf5dd6c1847326a7c9c92213a8e5f1ec6e57ab1ef40db9c: Status 404 returned error can't find the container with id 3b0506290585f6eb0bf5dd6c1847326a7c9c92213a8e5f1ec6e57ab1ef40db9c
Jul 06 20:10:03.060348 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:03.060321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w" event={"ID":"c0477dd0-101b-49e3-ba85-9dcd96aac44b","Type":"ContainerStarted","Data":"3b0506290585f6eb0bf5dd6c1847326a7c9c92213a8e5f1ec6e57ab1ef40db9c"}
Jul 06 20:10:04.066655 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:04.066614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w" event={"ID":"c0477dd0-101b-49e3-ba85-9dcd96aac44b","Type":"ContainerStarted","Data":"67c73eb5be21800cc72dac42648fe95d5df8c2241b26216712d6db8dfcba20c5"}
Jul 06 20:10:04.067056 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:04.066674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:04.092609 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:04.092558    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w" podStartSLOduration=2.092539579 podStartE2EDuration="2.092539579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:04.091225064 +0000 UTC m=+1143.474883813" watchObservedRunningTime="2026-07-06 20:10:04.092539579 +0000 UTC m=+1143.476198330"
Jul 06 20:10:15.074922 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:15.074887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:10:25.969861 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:25.969829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:10:27.168652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:27.168619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:34.958873 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:34.958831    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:10:50.171889 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:10:50.171852    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:11:01.042193 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:01.042157    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:11:01.045010 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:01.044983    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:11:02.048182 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:02.048144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:11:14.161297 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:14.161257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:11:23.358287 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:23.358248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:11:32.659322 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:32.659280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:11:43.756575 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:43.756536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:11:55.752473 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:11:55.752387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:12:04.051123 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:12:04.051077    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:12:15.167719 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:12:15.167681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:12:22.350498 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:12:22.350462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:12:39.772807 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:12:39.772763    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:12:47.563507 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:12:47.563466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:12:57.774915 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:12:57.774873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:13:07.050248 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:13:07.050208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:13:13.552414 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:13:13.552357    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:13:30.416683 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:13:30.416597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:13:40.358991 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:13:40.358944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:13:49.655028 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:13:49.654993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:13:58.473735 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:13:58.473677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:14:09.555806 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:09.555774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:14:19.088354 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:19.088312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:14:32.547384 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:32.547330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:14:46.774494 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:46.774373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:14:47.557946 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:47.557912    2581 generic.go:356] "Generic (PLEG): container finished" podID="c0477dd0-101b-49e3-ba85-9dcd96aac44b" containerID="67c73eb5be21800cc72dac42648fe95d5df8c2241b26216712d6db8dfcba20c5" exitCode=0
Jul 06 20:14:47.558132 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:47.557983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w" event={"ID":"c0477dd0-101b-49e3-ba85-9dcd96aac44b","Type":"ContainerDied","Data":"67c73eb5be21800cc72dac42648fe95d5df8c2241b26216712d6db8dfcba20c5"}
Jul 06 20:14:47.558328 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:47.558315    2581 scope.go:117] "RemoveContainer" containerID="67c73eb5be21800cc72dac42648fe95d5df8c2241b26216712d6db8dfcba20c5"
Jul 06 20:14:48.566471 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:48.566429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w" event={"ID":"c0477dd0-101b-49e3-ba85-9dcd96aac44b","Type":"ContainerStarted","Data":"5e0fbd067b44652801ae52f7651419a0abcc0000b1e95c7b0b300557fc37eb9c"}
Jul 06 20:14:48.566877 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:48.566637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:14:55.734472 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:55.734346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:14:59.573788 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:14:59.573751    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pdw9w"
Jul 06 20:15:13.038920 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:13.038883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:15:23.489254 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:23.489214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:15:23.554428 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:23.554394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:15:24.541484 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:24.541447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:15:33.844242 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:33.844204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:15:44.635578 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:44.635539    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:15:56.836665 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:15:56.836626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:16:01.075529 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:01.075498    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:16:01.080220 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:01.080191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:16:08.451608 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:08.451571    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:16:19.750079 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:19.750031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:16:23.899455 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:23.899320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:28.633677 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:28.633640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:16:32.860059 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:32.860022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:41.127385 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:41.127324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:41.860576 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:41.860537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:16:46.220453 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:46.220419    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:49.173790 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:49.173755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:49.361233 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:49.361195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:49.624557 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:49.624518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:50.259420 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:50.259382    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:16:55.340790 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.340755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:55.408651 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.408613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:55.528543 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.528518    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"]
Jul 06 20:16:55.528979 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.528967    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2114be-01e3-4c22-807f-511f97d1b65b" containerName="manager"
Jul 06 20:16:55.532219 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.532200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.534296 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.534273    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eda21f01-openshift-default-dockercfg-vfw2n\""
Jul 06 20:16:55.559133 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.559103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"]
Jul 06 20:16:55.562672 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.562646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:55.625580 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-socket\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.625580 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a456a28-e636-4a87-ac35-a57f41718479-istiod-ca-cert\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.625801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-certs\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.625801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-istio-token\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.625801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-data\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.625801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-envoy\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.625801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-credential-socket\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.626031 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a456a28-e636-4a87-ac35-a57f41718479-istio-podinfo\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.626031 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.625871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ztl\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-kube-api-access-p7ztl\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.638903 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.638867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:55.727071 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-socket\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727242 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a456a28-e636-4a87-ac35-a57f41718479-istiod-ca-cert\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727242 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-certs\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727242 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-istio-token\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727242 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-data\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727242 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-envoy\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-credential-socket\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a456a28-e636-4a87-ac35-a57f41718479-istio-podinfo\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ztl\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-kube-api-access-p7ztl\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727770 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727738    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-socket\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.727833 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.727780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-data\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.728036 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.728001    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-certs\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.728121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.728032    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-credential-socket\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.728453 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.728431    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a456a28-e636-4a87-ac35-a57f41718479-istiod-ca-cert\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.729870 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.729846    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-envoy\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.730094 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.730076    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a456a28-e636-4a87-ac35-a57f41718479-istio-podinfo\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.736314 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.736283    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-istio-token\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.736445 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.736407    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ztl\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-kube-api-access-p7ztl\") pod \"e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") " pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:55.843106 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:55.843064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:56.019052 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.019015    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"]
Jul 06 20:16:56.029135 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:16:56.029101    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a456a28_e636_4a87_ac35_a57f41718479.slice/crio-e9eb94245807646c7ddad442a02f618c38b65570d164e1986b9fe7a52e4335c9 WatchSource:0}: Error finding container e9eb94245807646c7ddad442a02f618c38b65570d164e1986b9fe7a52e4335c9: Status 404 returned error can't find the container with id e9eb94245807646c7ddad442a02f618c38b65570d164e1986b9fe7a52e4335c9
Jul 06 20:16:56.031515 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.031475    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:16:56.031617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.031596    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:16:56.031661 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.031647    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:16:56.238176 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.238062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j" event={"ID":"6a456a28-e636-4a87-ac35-a57f41718479","Type":"ContainerStarted","Data":"b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6"}
Jul 06 20:16:56.238176 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.238134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j" event={"ID":"6a456a28-e636-4a87-ac35-a57f41718479","Type":"ContainerStarted","Data":"e9eb94245807646c7ddad442a02f618c38b65570d164e1986b9fe7a52e4335c9"}
Jul 06 20:16:56.269710 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.269659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j" podStartSLOduration=1.2696399999999999 podStartE2EDuration="1.26964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:56.269079975 +0000 UTC m=+1555.652738758" watchObservedRunningTime="2026-07-06 20:16:56.26964 +0000 UTC m=+1555.653298750"
Jul 06 20:16:56.843677 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.843638    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:56.974203 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:56.974164    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:57.124452 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:57.124351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:57.202570 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:57.202536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:57.605013 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:57.604975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:57.702527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:57.702491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:57.802465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:57.802432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:16:57.849516 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:57.849483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:58.249883 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:58.249846    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:58.250964 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:58.250944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:16:59.227596 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:16:59.227569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:00.166286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:00.166256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:00.166550 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:00.166422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:17:00.263717 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:00.263680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:01.918049 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:01.918006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:02.031066 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:02.031028    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"]
Jul 06 20:17:02.031290 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:02.031254    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j" podUID="6a456a28-e636-4a87-ac35-a57f41718479" containerName="istio-proxy" containerID="cri-o://b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6" gracePeriod=30
Jul 06 20:17:02.114573 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:02.114539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:02.296109 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:02.295951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:02.459338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:02.459304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:05.208874 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:05.208845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:07.890838 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:07.890802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:07.990914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:07.990880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:08.000070 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.000044    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:17:08.107974 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.107889    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"]
Jul 06 20:17:08.108293 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.108281    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a456a28-e636-4a87-ac35-a57f41718479" containerName="istio-proxy"
Jul 06 20:17:08.108335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.108295    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a456a28-e636-4a87-ac35-a57f41718479" containerName="istio-proxy"
Jul 06 20:17:08.108407 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.108378    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a456a28-e636-4a87-ac35-a57f41718479" containerName="istio-proxy"
Jul 06 20:17:08.111397 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.111377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.116134 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.115698    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d8100888-openshift-default-dockercfg-4spx4\""
Jul 06 20:17:08.147021 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.146992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-envoy\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147182 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147100    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-data\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147182 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147143    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-socket\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147270 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-istio-token\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147270 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-certs\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147351 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147273    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-credential-socket\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147351 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147310    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a456a28-e636-4a87-ac35-a57f41718479-istiod-ca-cert\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147351 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a456a28-e636-4a87-ac35-a57f41718479-istio-podinfo\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147509 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7ztl\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-kube-api-access-p7ztl\") pod \"6a456a28-e636-4a87-ac35-a57f41718479\" (UID: \"6a456a28-e636-4a87-ac35-a57f41718479\") "
Jul 06 20:17:08.147835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147807    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:08.148038 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.147974    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:08.148261 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.148189    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:08.148458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.148261    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a456a28-e636-4a87-ac35-a57f41718479-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:17:08.148458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.148453    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:08.149823 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.149797    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:08.150234 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.150211    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-kube-api-access-p7ztl" (OuterVolumeSpecName: "kube-api-access-p7ztl") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "kube-api-access-p7ztl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:17:08.150420 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.150358    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:17:08.150725 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.150705    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a456a28-e636-4a87-ac35-a57f41718479-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a456a28-e636-4a87-ac35-a57f41718479" (UID: "6a456a28-e636-4a87-ac35-a57f41718479"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:17:08.160522 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.160496    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"]
Jul 06 20:17:08.249142 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-kube-api-access-9tqmv\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-certs\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-envoy\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-podinfo\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-token\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-data\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caad7b28-20b8-48f5-8188-7ad6952e5a46-istiod-ca-cert\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-credential-socket\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-socket\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249521    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249533    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249541    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249549    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249557    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249565    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a456a28-e636-4a87-ac35-a57f41718479-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249573    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a456a28-e636-4a87-ac35-a57f41718479-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249581    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7ztl\" (UniqueName: \"kubernetes.io/projected/6a456a28-e636-4a87-ac35-a57f41718479-kube-api-access-p7ztl\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.249617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.249589    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a456a28-e636-4a87-ac35-a57f41718479-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:08.285292 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.285250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:08.316532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.316489    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a456a28-e636-4a87-ac35-a57f41718479" containerID="b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6" exitCode=0
Jul 06 20:17:08.316805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.316545    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"
Jul 06 20:17:08.316805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.316569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j" event={"ID":"6a456a28-e636-4a87-ac35-a57f41718479","Type":"ContainerDied","Data":"b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6"}
Jul 06 20:17:08.316805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.316632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j" event={"ID":"6a456a28-e636-4a87-ac35-a57f41718479","Type":"ContainerDied","Data":"e9eb94245807646c7ddad442a02f618c38b65570d164e1986b9fe7a52e4335c9"}
Jul 06 20:17:08.316805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.316698    2581 scope.go:117] "RemoveContainer" containerID="b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6"
Jul 06 20:17:08.326789 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.326767    2581 scope.go:117] "RemoveContainer" containerID="b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6"
Jul 06 20:17:08.327075 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:17:08.327057    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6\": container with ID starting with b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6 not found: ID does not exist" containerID="b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6"
Jul 06 20:17:08.327121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.327084    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6"} err="failed to get container status \"b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6\": rpc error: code = NotFound desc = could not find container \"b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6\": container with ID starting with b18ea345aef9fc035058ad5b519114e5721667067357c382515c685549a683d6 not found: ID does not exist"
Jul 06 20:17:08.346690 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.346659    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"]
Jul 06 20:17:08.350778 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-certs\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.350862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-envoy\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.350862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-podinfo\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.350862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-token\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.350862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-data\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caad7b28-20b8-48f5-8188-7ad6952e5a46-istiod-ca-cert\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-credential-socket\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.350979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-socket\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.351014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-kube-api-access-9tqmv\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351321 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.351293    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-certs\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351414 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.351377    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-data\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351477 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.351436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-credential-socket\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.351477 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.351455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-socket\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.352253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.352224    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caad7b28-20b8-48f5-8188-7ad6952e5a46-istiod-ca-cert\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.353184 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.353165    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-envoy\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.353557 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.353542    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-podinfo\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.369596 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.369529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-kube-api-access-9tqmv\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.370161 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.370137    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eda21f01-openshift-default-5bcf687947-4wk6j"]
Jul 06 20:17:08.370953 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.370925    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-token\") pod \"e2e-ait-d8100888-openshift-default-869f854cd9-v27qd\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") " pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.426858 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.426820    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:08.448115 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.448067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:08.574945 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.574906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"]
Jul 06 20:17:08.577509 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:17:08.577476    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaad7b28_20b8_48f5_8188_7ad6952e5a46.slice/crio-2bfa02eac5054424b340e99128a445cb87c252892ad68d550e348a5ece5ed8b6 WatchSource:0}: Error finding container 2bfa02eac5054424b340e99128a445cb87c252892ad68d550e348a5ece5ed8b6: Status 404 returned error can't find the container with id 2bfa02eac5054424b340e99128a445cb87c252892ad68d550e348a5ece5ed8b6
Jul 06 20:17:08.579751 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.579713    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:17:08.579823 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.579800    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:17:08.579869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:08.579852    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:17:09.024197 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.024113    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a456a28-e636-4a87-ac35-a57f41718479" path="/var/lib/kubelet/pods/6a456a28-e636-4a87-ac35-a57f41718479/volumes"
Jul 06 20:17:09.324424 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.324379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd" event={"ID":"caad7b28-20b8-48f5-8188-7ad6952e5a46","Type":"ContainerStarted","Data":"abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c"}
Jul 06 20:17:09.324605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.324442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd" event={"ID":"caad7b28-20b8-48f5-8188-7ad6952e5a46","Type":"ContainerStarted","Data":"2bfa02eac5054424b340e99128a445cb87c252892ad68d550e348a5ece5ed8b6"}
Jul 06 20:17:09.345160 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.345111    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd" podStartSLOduration=1.3450922699999999 podStartE2EDuration="1.34509227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:17:09.343735426 +0000 UTC m=+1568.727394177" watchObservedRunningTime="2026-07-06 20:17:09.34509227 +0000 UTC m=+1568.728751102"
Jul 06 20:17:09.348885 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.348857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:09.427735 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.427700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:09.433595 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.433571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:09.443124 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.443093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:09.517525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.517491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:09.668456 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:09.668344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:10.003319 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:10.003215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:10.104945 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:10.104914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:10.330944 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:10.330915    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:10.331998 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:10.331977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:11.440235 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:11.440198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:12.741504 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:12.741461    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:17:14.455638 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:14.455607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:14.825946 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:14.825918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:20.576571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.576534    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"]
Jul 06 20:17:20.576989 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.576725    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd" podUID="caad7b28-20b8-48f5-8188-7ad6952e5a46" containerName="istio-proxy" containerID="cri-o://abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c" gracePeriod=30
Jul 06 20:17:20.620480 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.620450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:20.727852 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.727828    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:20.734535 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.734510    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:20.877890 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.877856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caad7b28-20b8-48f5-8188-7ad6952e5a46-istiod-ca-cert\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878082 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.877927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-socket\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878082 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.877957    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-podinfo\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878082 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.877983    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-credential-socket\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878082 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-data\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878288 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-certs\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878288 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878241    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:20.878436 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-token\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878436 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878322    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caad7b28-20b8-48f5-8188-7ad6952e5a46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:17:20.878436 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-kube-api-access-9tqmv\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878436 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878390    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-envoy\") pod \"caad7b28-20b8-48f5-8188-7ad6952e5a46\" (UID: \"caad7b28-20b8-48f5-8188-7ad6952e5a46\") "
Jul 06 20:17:20.878436 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878357    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:20.878693 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878592    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:20.878840 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878814    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.878840 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878841    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.879215 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878856    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.879215 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.878872    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caad7b28-20b8-48f5-8188-7ad6952e5a46-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.879215 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.879029    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-data" (OuterVolumeSpecName: "istio-data") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:20.880587 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.880559    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-kube-api-access-9tqmv" (OuterVolumeSpecName: "kube-api-access-9tqmv") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "kube-api-access-9tqmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:17:20.880689 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.880671    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:17:20.880733 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.880674    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:20.880889 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.880869    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-token" (OuterVolumeSpecName: "istio-token") pod "caad7b28-20b8-48f5-8188-7ad6952e5a46" (UID: "caad7b28-20b8-48f5-8188-7ad6952e5a46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:17:20.979864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.979823    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.979864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.979856    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.979864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.979864    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.980105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.979874    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/caad7b28-20b8-48f5-8188-7ad6952e5a46-kube-api-access-9tqmv\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:20.980105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:20.979884    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caad7b28-20b8-48f5-8188-7ad6952e5a46-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:21.400641 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.400605    2581 generic.go:356] "Generic (PLEG): container finished" podID="caad7b28-20b8-48f5-8188-7ad6952e5a46" containerID="abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c" exitCode=0
Jul 06 20:17:21.400825 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.400654    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"
Jul 06 20:17:21.400825 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.400690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd" event={"ID":"caad7b28-20b8-48f5-8188-7ad6952e5a46","Type":"ContainerDied","Data":"abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c"}
Jul 06 20:17:21.400825 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.400743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd" event={"ID":"caad7b28-20b8-48f5-8188-7ad6952e5a46","Type":"ContainerDied","Data":"2bfa02eac5054424b340e99128a445cb87c252892ad68d550e348a5ece5ed8b6"}
Jul 06 20:17:21.400825 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.400764    2581 scope.go:117] "RemoveContainer" containerID="abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c"
Jul 06 20:17:21.410079 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.410051    2581 scope.go:117] "RemoveContainer" containerID="abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c"
Jul 06 20:17:21.410337 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:17:21.410318    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c\": container with ID starting with abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c not found: ID does not exist" containerID="abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c"
Jul 06 20:17:21.410418 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.410346    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c"} err="failed to get container status \"abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c\": rpc error: code = NotFound desc = could not find container \"abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c\": container with ID starting with abf779741aeb2bd959194c2d063d57e584cbdfdf7a52d686abc051a22883df8c not found: ID does not exist"
Jul 06 20:17:21.428319 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.428265    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"]
Jul 06 20:17:21.431035 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:21.431012    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d8100888-openshift-default-869f854cd9-v27qd"]
Jul 06 20:17:22.923545 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:22.923514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:23.023908 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:23.023877    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caad7b28-20b8-48f5-8188-7ad6952e5a46" path="/var/lib/kubelet/pods/caad7b28-20b8-48f5-8188-7ad6952e5a46/volumes"
Jul 06 20:17:24.679925 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:24.679885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:17:26.882491 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:26.882450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:26.981962 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:26.981931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:27.081159 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.081120    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"]
Jul 06 20:17:27.081785 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.081761    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caad7b28-20b8-48f5-8188-7ad6952e5a46" containerName="istio-proxy"
Jul 06 20:17:27.081872 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.081789    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="caad7b28-20b8-48f5-8188-7ad6952e5a46" containerName="istio-proxy"
Jul 06 20:17:27.081929 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.081919    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="caad7b28-20b8-48f5-8188-7ad6952e5a46" containerName="istio-proxy"
Jul 06 20:17:27.086991 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.086962    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.089847 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.089823    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b341f026-openshift-default-dockercfg-dwg8l\""
Jul 06 20:17:27.111128 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.111100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"]
Jul 06 20:17:27.120750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.120724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:27.135929 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.135834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-podinfo\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.135929 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.135872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-socket\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.135976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-data\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.136057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-credential-socket\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.136081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-token\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.136100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk8sl\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-kube-api-access-zk8sl\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.136144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-certs\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.136167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istiod-ca-cert\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.136280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.136203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-envoy\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.209586 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.209546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:27.236924 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.236889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-data\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.236952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-credential-socket\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.236971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-token\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.236988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk8sl\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-kube-api-access-zk8sl\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-certs\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istiod-ca-cert\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-envoy\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-podinfo\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237480 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-socket\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237480 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237403    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-data\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237584 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-certs\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237640 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-socket\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.237819 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237790    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-credential-socket\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.238120 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.237925    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istiod-ca-cert\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.239672 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.239652    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-envoy\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.240016 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.239994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-podinfo\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.248274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.248247    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-token\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.248441 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.248419    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk8sl\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-kube-api-access-zk8sl\") pod \"e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") " pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.397825 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.397734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:27.555187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.555153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"]
Jul 06 20:17:27.558216 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:17:27.558183    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65016f6_2f5a_4d92_a12f_07f8603a9ff5.slice/crio-0a505c56d34218233468c5e7eacff131695bf1228e62b9282bbc48ecf763da3b WatchSource:0}: Error finding container 0a505c56d34218233468c5e7eacff131695bf1228e62b9282bbc48ecf763da3b: Status 404 returned error can't find the container with id 0a505c56d34218233468c5e7eacff131695bf1228e62b9282bbc48ecf763da3b
Jul 06 20:17:27.560791 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.560759    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:17:27.560862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.560827    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:17:27.560862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:27.560858    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:17:28.440273 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:28.440235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr" event={"ID":"e65016f6-2f5a-4d92-a12f-07f8603a9ff5","Type":"ContainerStarted","Data":"bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630"}
Jul 06 20:17:28.440802 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:28.440302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr" event={"ID":"e65016f6-2f5a-4d92-a12f-07f8603a9ff5","Type":"ContainerStarted","Data":"0a505c56d34218233468c5e7eacff131695bf1228e62b9282bbc48ecf763da3b"}
Jul 06 20:17:28.525346 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:28.525317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:28.622467 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:28.622435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:29.036979 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.036950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:29.137946 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.137913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:29.390170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.390134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:29.398116 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.398079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:29.403386 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.403350    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:29.426306 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.426239    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr" podStartSLOduration=2.426219008 podStartE2EDuration="2.426219008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:17:28.469809154 +0000 UTC m=+1587.853467904" watchObservedRunningTime="2026-07-06 20:17:29.426219008 +0000 UTC m=+1588.809877759"
Jul 06 20:17:29.446619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.446587    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:29.447637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:29.447617    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:30.175793 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:30.175758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:32.702344 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:32.702305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:32.849133 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:32.849084    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"]
Jul 06 20:17:32.849329 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:32.849305    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr" podUID="e65016f6-2f5a-4d92-a12f-07f8603a9ff5" containerName="istio-proxy" containerID="cri-o://bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630" gracePeriod=30
Jul 06 20:17:32.879922 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:32.879883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:32.979173 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:32.979080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:33.085013 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:33.084981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:34.229445 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:34.229415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:38.094828 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.094800    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:38.131617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-envoy\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131583    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-podinfo\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk8sl\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-kube-api-access-zk8sl\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-data\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131651    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-certs\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-socket\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-credential-socket\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-token\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.131914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istiod-ca-cert\") pod \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\" (UID: \"e65016f6-2f5a-4d92-a12f-07f8603a9ff5\") "
Jul 06 20:17:38.132253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131967    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:38.132253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.131986    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:38.132253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.132149    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:38.132253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.132156    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.132253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.132204    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:38.132253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.132218    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.132608 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.132266    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:17:38.134053 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.134017    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-kube-api-access-zk8sl" (OuterVolumeSpecName: "kube-api-access-zk8sl") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "kube-api-access-zk8sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:17:38.134335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.134315    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:17:38.134452 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.134431    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:17:38.134532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.134509    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e65016f6-2f5a-4d92-a12f-07f8603a9ff5" (UID: "e65016f6-2f5a-4d92-a12f-07f8603a9ff5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:17:38.232914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232877    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk8sl\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-kube-api-access-zk8sl\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.232914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232910    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.232914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232921    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.233158 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232934    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.233158 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232945    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.233158 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232952    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.233158 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.232960    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65016f6-2f5a-4d92-a12f-07f8603a9ff5-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:17:38.500225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.500132    2581 generic.go:356] "Generic (PLEG): container finished" podID="e65016f6-2f5a-4d92-a12f-07f8603a9ff5" containerID="bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630" exitCode=0
Jul 06 20:17:38.500225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.500185    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"
Jul 06 20:17:38.500440 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.500222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr" event={"ID":"e65016f6-2f5a-4d92-a12f-07f8603a9ff5","Type":"ContainerDied","Data":"bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630"}
Jul 06 20:17:38.500440 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.500302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr" event={"ID":"e65016f6-2f5a-4d92-a12f-07f8603a9ff5","Type":"ContainerDied","Data":"0a505c56d34218233468c5e7eacff131695bf1228e62b9282bbc48ecf763da3b"}
Jul 06 20:17:38.500440 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.500325    2581 scope.go:117] "RemoveContainer" containerID="bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630"
Jul 06 20:17:38.510126 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.510108    2581 scope.go:117] "RemoveContainer" containerID="bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630"
Jul 06 20:17:38.510425 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:17:38.510398    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630\": container with ID starting with bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630 not found: ID does not exist" containerID="bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630"
Jul 06 20:17:38.510519 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.510432    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630"} err="failed to get container status \"bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630\": rpc error: code = NotFound desc = could not find container \"bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630\": container with ID starting with bc018907face366b3431a0bdfd1591d2de410b30114743f6c7e0154d585d2630 not found: ID does not exist"
Jul 06 20:17:38.521607 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.521578    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"]
Jul 06 20:17:38.525012 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.524991    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b341f026-openshift-default-6bf5f4657f-rpgrr"]
Jul 06 20:17:38.863036 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.862997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:38.936707 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:38.936676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:39.024000 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:39.023969    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e65016f6-2f5a-4d92-a12f-07f8603a9ff5" path="/var/lib/kubelet/pods/e65016f6-2f5a-4d92-a12f-07f8603a9ff5/volumes"
Jul 06 20:17:39.357791 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:39.357758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:39.453700 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:39.453670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:39.553088 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:39.553057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:40.909113 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:40.909078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:47.189976 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:47.189942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:47.406897 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:47.406864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:47.560141 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:47.560107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:17:47.929612 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:17:47.929525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:13.877555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:13.877525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:19.925286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:19.925246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:20.029248 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:20.029217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:20.123227 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:20.123198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:36.011740 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:36.011700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:41.705538 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:41.705505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:41.807266 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:41.807234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:41.951994 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:41.951959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:52.434454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:52.434413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:53.248416 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:53.248353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:59.148771 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:59.148735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:59.215961 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:59.215923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:59.315089 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:59.315054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:59.415802 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:59.415708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:59.516317 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:18:59.516281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:00.226301 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:00.226265    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:00.328404 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:00.328357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:00.425672 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:00.425643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:01.995060 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:01.995007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:02.537800 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:02.537762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:19:04.149339 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:04.149303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:07.735341 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:07.735300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:07.794444 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:07.794353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:08.380268 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:08.380230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:11.629864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:11.629829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:19:14.153660 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.153623    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:14.210736 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.210703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:14.377553 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.377521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:14.668653 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.668621    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"]
Jul 06 20:19:14.669027 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.669015    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65016f6-2f5a-4d92-a12f-07f8603a9ff5" containerName="istio-proxy"
Jul 06 20:19:14.669073 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.669029    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65016f6-2f5a-4d92-a12f-07f8603a9ff5" containerName="istio-proxy"
Jul 06 20:19:14.669120 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.669102    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65016f6-2f5a-4d92-a12f-07f8603a9ff5" containerName="istio-proxy"
Jul 06 20:19:14.672346 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.672330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.675934 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.675903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-762fdb2a-openshift-default-dockercfg-dg6tj\""
Jul 06 20:19:14.698604 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.698576    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"]
Jul 06 20:19:14.704637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istiod-ca-cert\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.704772 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnkz\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-kube-api-access-mwnkz\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.704772 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-token\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.704869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-credential-socket\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.704869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-podinfo\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.704869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-socket\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.704869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-certs\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.705041 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-envoy\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.705041 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.704907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-data\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.710592 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.710565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:14.805582 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-credential-socket\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805582 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-podinfo\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-socket\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-certs\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-envoy\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-data\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istiod-ca-cert\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnkz\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-kube-api-access-mwnkz\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.805846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-token\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.806187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.805983    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-credential-socket\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.806187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.806046    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-socket\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.806260 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.806200    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-data\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.806260 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.806222    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-certs\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.806532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.806512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istiod-ca-cert\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.808214 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.808195    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-podinfo\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.808402 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.808381    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-envoy\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.814430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.814409    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnkz\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-kube-api-access-mwnkz\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.814554 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.814533    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-token\") pod \"e2e-mt-762fdb2a-openshift-default-596646b675-spcsl\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") " pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:14.986105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:14.986001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:15.041854 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:15.041739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:15.152763 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:15.152737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"]
Jul 06 20:19:15.155271 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:19:15.155244    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbd37a5_2226_440e_88ae_f42bfdd3e97e.slice/crio-94e8d178c4d04d79a3342616bfe21bd6be7b97e6d7b491c4986b55f0c4205274 WatchSource:0}: Error finding container 94e8d178c4d04d79a3342616bfe21bd6be7b97e6d7b491c4986b55f0c4205274: Status 404 returned error can't find the container with id 94e8d178c4d04d79a3342616bfe21bd6be7b97e6d7b491c4986b55f0c4205274
Jul 06 20:19:15.157582 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:15.157547    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:15.157666 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:15.157611    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:15.157666 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:15.157641    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:16.022895 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:16.022858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" event={"ID":"afbd37a5-2226-440e-88ae-f42bfdd3e97e","Type":"ContainerStarted","Data":"6430510ac081861ba2a1c8a6247e036215b221e3ce909c9ac7bce8eb23dbf763"}
Jul 06 20:19:16.023078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:16.022910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" event={"ID":"afbd37a5-2226-440e-88ae-f42bfdd3e97e","Type":"ContainerStarted","Data":"94e8d178c4d04d79a3342616bfe21bd6be7b97e6d7b491c4986b55f0c4205274"}
Jul 06 20:19:16.047008 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:16.046952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" podStartSLOduration=2.046936688 podStartE2EDuration="2.046936688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:16.045168774 +0000 UTC m=+1695.428827524" watchObservedRunningTime="2026-07-06 20:19:16.046936688 +0000 UTC m=+1695.430595415"
Jul 06 20:19:16.986373 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:16.986332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:16.991440 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:16.991416    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:17.027771 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:17.027745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:17.028804 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:17.028782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:17.939327 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:17.939272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:18.044125 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:18.044086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:18.132268 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:18.132226    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:18.354636 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:18.354597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:18.532831 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:18.532796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:18.633096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:18.633005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.488134 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:22.488060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:23.097622 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:23.097588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:23.185936 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:23.185906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:23.549792 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:23.549753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:23.553343 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:23.553317    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:19:25.378227 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:25.378184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:25.474903 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:25.474872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:29.278468 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:29.278430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:29.340430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:29.340358    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:29.683039 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:29.683003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:30.063914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:30.063880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:30.163598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:30.163544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:30.263747 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:30.263710    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:30.368880 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:30.368798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:32.029752 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.029713    2581 patch_prober.go:28] interesting pod/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:19:32.030190 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.029780    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 20:19:32.115672 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.115638    2581 generic.go:356] "Generic (PLEG): container finished" podID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerID="6430510ac081861ba2a1c8a6247e036215b221e3ce909c9ac7bce8eb23dbf763" exitCode=0
Jul 06 20:19:32.115860 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.115686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" event={"ID":"afbd37a5-2226-440e-88ae-f42bfdd3e97e","Type":"ContainerDied","Data":"6430510ac081861ba2a1c8a6247e036215b221e3ce909c9ac7bce8eb23dbf763"}
Jul 06 20:19:32.116116 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.116098    2581 scope.go:117] "RemoveContainer" containerID="6430510ac081861ba2a1c8a6247e036215b221e3ce909c9ac7bce8eb23dbf763"
Jul 06 20:19:32.117186 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.117150    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:32.117283 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.117223    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:32.117283 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.117256    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:32.538116 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:32.538079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:19:33.123279 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:33.123240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" event={"ID":"afbd37a5-2226-440e-88ae-f42bfdd3e97e","Type":"ContainerStarted","Data":"043fa2a5271b38d3ae1a8ec78a81bc241a7246c26d52709160c0fafa1049b3d9"}
Jul 06 20:19:33.987217 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:33.987171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:33.987463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:33.987310    2581 patch_prober.go:28] interesting pod/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:19:33.987463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:33.987355    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 20:19:34.987055 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:34.987014    2581 patch_prober.go:28] interesting pod/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:19:34.987727 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:34.987696    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 20:19:35.789997 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:35.789961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:35.858872 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:35.858840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:35.986693 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:35.986657    2581 patch_prober.go:28] interesting pod/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:19:35.987020 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:35.986991    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 20:19:36.094113 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.094064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"]
Jul 06 20:19:36.094656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.094303    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy" containerID="cri-o://043fa2a5271b38d3ae1a8ec78a81bc241a7246c26d52709160c0fafa1049b3d9" gracePeriod=30
Jul 06 20:19:36.144990 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.144960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:36.303726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.303695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:36.430140 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.430051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:36.534828 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.534781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:36.662621 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:36.662577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:42.172549 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.172508    2581 generic.go:356] "Generic (PLEG): container finished" podID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerID="043fa2a5271b38d3ae1a8ec78a81bc241a7246c26d52709160c0fafa1049b3d9" exitCode=0
Jul 06 20:19:42.172948 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.172582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" event={"ID":"afbd37a5-2226-440e-88ae-f42bfdd3e97e","Type":"ContainerDied","Data":"043fa2a5271b38d3ae1a8ec78a81bc241a7246c26d52709160c0fafa1049b3d9"}
Jul 06 20:19:42.172948 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.172652    2581 scope.go:117] "RemoveContainer" containerID="6430510ac081861ba2a1c8a6247e036215b221e3ce909c9ac7bce8eb23dbf763"
Jul 06 20:19:42.267637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.267567    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:42.335769 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.335735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:42.370086 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-data\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370086 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-envoy\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370326 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-token\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370326 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370210    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-credential-socket\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370326 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-socket\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370326 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370264    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istiod-ca-cert\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370326 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-podinfo\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370326 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370311    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-certs\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370674 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370555    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:19:42.370674 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370582    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:19:42.370674 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370600    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:19:42.370674 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwnkz\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-kube-api-access-mwnkz\") pod \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\" (UID: \"afbd37a5-2226-440e-88ae-f42bfdd3e97e\") "
Jul 06 20:19:42.370938 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370907    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-data" (OuterVolumeSpecName: "istio-data") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:19:42.371073 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370945    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.371073 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370966    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.371073 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370982    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.371073 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.370965    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:19:42.372684 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.372615    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-token" (OuterVolumeSpecName: "istio-token") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:19:42.372794 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.372731    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-kube-api-access-mwnkz" (OuterVolumeSpecName: "kube-api-access-mwnkz") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "kube-api-access-mwnkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:19:42.372794 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.372737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:19:42.373010 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.372980    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "afbd37a5-2226-440e-88ae-f42bfdd3e97e" (UID: "afbd37a5-2226-440e-88ae-f42bfdd3e97e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:19:42.401425 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.401391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:42.471621 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.471587    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.471621 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.471618    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.471621 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.471627    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwnkz\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-kube-api-access-mwnkz\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.471923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.471641    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.471923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.471653    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.471923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.471661    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afbd37a5-2226-440e-88ae-f42bfdd3e97e-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:19:42.485553 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.485526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:42.589109 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.589067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:42.727508 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:42.727469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:43.179375 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:43.179341    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"
Jul 06 20:19:43.179826 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:43.179405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl" event={"ID":"afbd37a5-2226-440e-88ae-f42bfdd3e97e","Type":"ContainerDied","Data":"94e8d178c4d04d79a3342616bfe21bd6be7b97e6d7b491c4986b55f0c4205274"}
Jul 06 20:19:43.179826 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:43.179468    2581 scope.go:117] "RemoveContainer" containerID="043fa2a5271b38d3ae1a8ec78a81bc241a7246c26d52709160c0fafa1049b3d9"
Jul 06 20:19:43.195727 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:43.195704    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"]
Jul 06 20:19:43.206731 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:43.202527    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-762fdb2a-openshift-default-596646b675-spcsl"]
Jul 06 20:19:45.023874 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:45.023841    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" path="/var/lib/kubelet/pods/afbd37a5-2226-440e-88ae-f42bfdd3e97e/volumes"
Jul 06 20:19:48.569581 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:48.569551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:49.968780 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:49.968745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:55.476733 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.476699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:55.767884 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.767792    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"]
Jul 06 20:19:55.769305 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.769276    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy"
Jul 06 20:19:55.769305 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.769306    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy"
Jul 06 20:19:55.769522 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.769337    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy"
Jul 06 20:19:55.769522 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.769346    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy"
Jul 06 20:19:55.769622 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.769589    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy"
Jul 06 20:19:55.769622 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.769610    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="afbd37a5-2226-440e-88ae-f42bfdd3e97e" containerName="istio-proxy"
Jul 06 20:19:55.775139 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.775114    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.777419 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.777389    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a2e2cfb4-openshift-default-dockercfg-s8p6p\""
Jul 06 20:19:55.782658 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.782632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"]
Jul 06 20:19:55.788602 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.788582    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:55.895175 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-credential-socket\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-socket\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-token\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istiod-ca-cert\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-certs\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-podinfo\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895539 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-envoy\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895539 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-data\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.895539 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.895472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8dth\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-kube-api-access-p8dth\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.996773 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-certs\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.996950 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-podinfo\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.996950 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-envoy\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.996950 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-data\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.996950 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8dth\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-kube-api-access-p8dth\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-credential-socket\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.996995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-socket\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-token\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istiod-ca-cert\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997225 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997190    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-certs\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997521 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997265    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-data\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997687 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997670    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istiod-ca-cert\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.997944 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997923    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-credential-socket\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.998028 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.997926    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-socket\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.999294 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.999276    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-envoy\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:55.999408 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:55.999385    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-podinfo\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:56.005804 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.005780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-token\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:56.005966 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.005949    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8dth\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-kube-api-access-p8dth\") pod \"e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") " pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:56.088669 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.088635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:56.289126 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:19:56.289094    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf92e2f6_466e_4f07_93e2_f1e410e7a3cb.slice/crio-f11396abb9668ec7d19e8cd267b1b4049c3d0f162b6744088fb3196bcc5068b7 WatchSource:0}: Error finding container f11396abb9668ec7d19e8cd267b1b4049c3d0f162b6744088fb3196bcc5068b7: Status 404 returned error can't find the container with id f11396abb9668ec7d19e8cd267b1b4049c3d0f162b6744088fb3196bcc5068b7
Jul 06 20:19:56.291534 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.291500    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:56.291612 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.291575    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:56.291651 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.291621    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:19:56.304441 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.304416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"]
Jul 06 20:19:56.395246 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:56.395168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:57.254847 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:57.254809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" event={"ID":"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb","Type":"ContainerStarted","Data":"58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"}
Jul 06 20:19:57.255252 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:57.254862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" event={"ID":"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb","Type":"ContainerStarted","Data":"f11396abb9668ec7d19e8cd267b1b4049c3d0f162b6744088fb3196bcc5068b7"}
Jul 06 20:19:57.277423 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:57.277357    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podStartSLOduration=2.277341314 podStartE2EDuration="2.277341314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:57.275452036 +0000 UTC m=+1736.659110785" watchObservedRunningTime="2026-07-06 20:19:57.277341314 +0000 UTC m=+1736.661000063"
Jul 06 20:19:58.089439 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:58.089398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:58.094324 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:58.094297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:58.260530 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:58.260503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:58.261531 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:58.261511    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:19:59.241268 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:59.241239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.367157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:59.367125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.475300 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:59.475260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.686671 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:19:59.686637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:00.076476 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:00.076446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:00.179787 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:00.179751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:03.909463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:03.909422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:06.037024 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:06.036987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:20:13.659669 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:13.658849    2581 patch_prober.go:28] interesting pod/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:47394->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Jul 06 20:20:13.659669 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:13.658928    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:47394->10.132.0.51:15021: read: connection reset by peer"
Jul 06 20:20:14.350506 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:14.350469    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerID="58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f" exitCode=0
Jul 06 20:20:14.350685 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:14.350547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" event={"ID":"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb","Type":"ContainerDied","Data":"58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"}
Jul 06 20:20:14.350950 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:14.350937    2581 scope.go:117] "RemoveContainer" containerID="58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"
Jul 06 20:20:14.351972 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:14.351943    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:20:14.352060 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:14.352021    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:20:14.352120 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:14.352059    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:20:15.357339 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:15.357307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" event={"ID":"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb","Type":"ContainerStarted","Data":"105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de"}
Jul 06 20:20:16.089617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.089583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:20:16.089993 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.089969    2581 patch_prober.go:28] interesting pod/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:20:16.090189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.090163    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 06 20:20:16.647920 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.647879    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"]
Jul 06 20:20:16.654419 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.654391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.657231 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.657206    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a2e2cfb4\"/\"e2e-lifecycle-model-a2e2cfb4-kserve-self-signed-certs\""
Jul 06 20:20:16.657538 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.657484    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a2e2cfb4\"/\"default-dockercfg-82qgw\""
Jul 06 20:20:16.657538 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.657501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a2e2cfb4\"/\"openshift-service-ca.crt\""
Jul 06 20:20:16.657841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.657824    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a2e2cfb4\"/\"kube-root-ca.crt\""
Jul 06 20:20:16.659140 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.659112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"]
Jul 06 20:20:16.701894 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.701012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-dshm\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.701894 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.701061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-model-cache\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.701894 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.701104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-tmp-dir\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.701894 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.701167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16e0167-12f6-4ddf-876e-54fe81f498cf-tls-certs\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.701894 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.701266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-home\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.701894 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.701294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjwc\" (UniqueName: \"kubernetes.io/projected/a16e0167-12f6-4ddf-876e-54fe81f498cf-kube-api-access-bjjwc\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.747859 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.747823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:16.802180 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16e0167-12f6-4ddf-876e-54fe81f498cf-tls-certs\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802433 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-home\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802433 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjwc\" (UniqueName: \"kubernetes.io/projected/a16e0167-12f6-4ddf-876e-54fe81f498cf-kube-api-access-bjjwc\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802433 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-dshm\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802433 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-model-cache\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802433 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-tmp-dir\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802725    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-home\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802886 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-tmp-dir\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.802973 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.802952    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-model-cache\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.805070 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.805049    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-dshm\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.805187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.805167    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16e0167-12f6-4ddf-876e-54fe81f498cf-tls-certs\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.810948 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.810917    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjwc\" (UniqueName: \"kubernetes.io/projected/a16e0167-12f6-4ddf-876e-54fe81f498cf-kube-api-access-bjjwc\") pod \"e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") " pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:16.965931 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:16.965825    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:17.092981 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:17.090801    2581 patch_prober.go:28] interesting pod/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:20:17.092981 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:17.090858    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 06 20:20:17.157847 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:17.157822    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"]
Jul 06 20:20:17.160936 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:20:17.160904    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda16e0167_12f6_4ddf_876e_54fe81f498cf.slice/crio-32bfd6058da35ac4732f6a51e65814b5269bf6cad33114f30c5a7cf1c8177801 WatchSource:0}: Error finding container 32bfd6058da35ac4732f6a51e65814b5269bf6cad33114f30c5a7cf1c8177801: Status 404 returned error can't find the container with id 32bfd6058da35ac4732f6a51e65814b5269bf6cad33114f30c5a7cf1c8177801
Jul 06 20:20:17.163342 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:17.163329    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:20:17.368515 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:17.368472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj" event={"ID":"a16e0167-12f6-4ddf-876e-54fe81f498cf","Type":"ContainerStarted","Data":"32bfd6058da35ac4732f6a51e65814b5269bf6cad33114f30c5a7cf1c8177801"}
Jul 06 20:20:18.094470 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:18.089452    2581 patch_prober.go:28] interesting pod/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:20:18.094470 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:18.089515    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 06 20:20:19.089555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:19.089056    2581 patch_prober.go:28] interesting pod/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:20:19.089555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:19.089119    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 06 20:20:19.387408 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:19.387305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj" event={"ID":"a16e0167-12f6-4ddf-876e-54fe81f498cf","Type":"ContainerStarted","Data":"9b7ea071e2851d9d6e631e96fcb48eda6b475ab2e1e9ca4bf0289689299b34e7"}
Jul 06 20:20:19.410588 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:19.410537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj" podStartSLOduration=1.8371164960000002 podStartE2EDuration="3.410518699s" totalImagesPullingTime="1.573402203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:20:19.407655847 +0000 UTC m=+1758.791314592" watchObservedRunningTime="2026-07-06 20:20:19.410518699 +0000 UTC m=+1758.794177448"
Jul 06 20:20:20.093093 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:20.093060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:20:20.093377 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:20.093338    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:20:20.094167 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:20.094151    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:20:20.642294 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:20.642255    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:20:26.965969 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:26.965928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:26.966505 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:26.965998    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:26.983443 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:26.983413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:27.439568 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:27.439539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:20:33.740215 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:33.740179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:20:36.278201 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:36.278162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:36.628948 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:36.628908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:42.398218 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:42.398187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:47.393484 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:47.393446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"]
Jul 06 20:20:47.496271 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:47.496237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:48.041447 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:20:48.041407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:21:01.110086 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:01.110054    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:21:01.119767 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:01.119742    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:21:02.414613 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.414566    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj" podUID="a16e0167-12f6-4ddf-876e-54fe81f498cf" containerName="main" containerID="cri-o://9b7ea071e2851d9d6e631e96fcb48eda6b475ab2e1e9ca4bf0289689299b34e7" gracePeriod=45
Jul 06 20:21:02.619183 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.619150    2581 generic.go:356] "Generic (PLEG): container finished" podID="a16e0167-12f6-4ddf-876e-54fe81f498cf" containerID="9b7ea071e2851d9d6e631e96fcb48eda6b475ab2e1e9ca4bf0289689299b34e7" exitCode=0
Jul 06 20:21:02.619380 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.619233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj" event={"ID":"a16e0167-12f6-4ddf-876e-54fe81f498cf","Type":"ContainerDied","Data":"9b7ea071e2851d9d6e631e96fcb48eda6b475ab2e1e9ca4bf0289689299b34e7"}
Jul 06 20:21:02.672996 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.672927    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:21:02.726238 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-tmp-dir\") pod \"a16e0167-12f6-4ddf-876e-54fe81f498cf\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") "
Jul 06 20:21:02.726465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726259    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-model-cache\") pod \"a16e0167-12f6-4ddf-876e-54fe81f498cf\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") "
Jul 06 20:21:02.726465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726280    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16e0167-12f6-4ddf-876e-54fe81f498cf-tls-certs\") pod \"a16e0167-12f6-4ddf-876e-54fe81f498cf\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") "
Jul 06 20:21:02.726465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726324    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjjwc\" (UniqueName: \"kubernetes.io/projected/a16e0167-12f6-4ddf-876e-54fe81f498cf-kube-api-access-bjjwc\") pod \"a16e0167-12f6-4ddf-876e-54fe81f498cf\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") "
Jul 06 20:21:02.726465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-dshm\") pod \"a16e0167-12f6-4ddf-876e-54fe81f498cf\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") "
Jul 06 20:21:02.726465 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726425    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-home\") pod \"a16e0167-12f6-4ddf-876e-54fe81f498cf\" (UID: \"a16e0167-12f6-4ddf-876e-54fe81f498cf\") "
Jul 06 20:21:02.726732 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726564    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "a16e0167-12f6-4ddf-876e-54fe81f498cf" (UID: "a16e0167-12f6-4ddf-876e-54fe81f498cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:02.726732 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726591    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a16e0167-12f6-4ddf-876e-54fe81f498cf" (UID: "a16e0167-12f6-4ddf-876e-54fe81f498cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:02.726835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726786    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:02.726835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726791    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-home" (OuterVolumeSpecName: "home") pod "a16e0167-12f6-4ddf-876e-54fe81f498cf" (UID: "a16e0167-12f6-4ddf-876e-54fe81f498cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:02.726835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.726808    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:02.728731 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.728709    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-dshm" (OuterVolumeSpecName: "dshm") pod "a16e0167-12f6-4ddf-876e-54fe81f498cf" (UID: "a16e0167-12f6-4ddf-876e-54fe81f498cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:02.728731 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.728720    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16e0167-12f6-4ddf-876e-54fe81f498cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a16e0167-12f6-4ddf-876e-54fe81f498cf" (UID: "a16e0167-12f6-4ddf-876e-54fe81f498cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:21:02.728873 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.728836    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16e0167-12f6-4ddf-876e-54fe81f498cf-kube-api-access-bjjwc" (OuterVolumeSpecName: "kube-api-access-bjjwc") pod "a16e0167-12f6-4ddf-876e-54fe81f498cf" (UID: "a16e0167-12f6-4ddf-876e-54fe81f498cf"). InnerVolumeSpecName "kube-api-access-bjjwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:21:02.827330 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.827286    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16e0167-12f6-4ddf-876e-54fe81f498cf-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:02.827330 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.827322    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjjwc\" (UniqueName: \"kubernetes.io/projected/a16e0167-12f6-4ddf-876e-54fe81f498cf-kube-api-access-bjjwc\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:02.827330 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.827336    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:02.827614 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:02.827347    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a16e0167-12f6-4ddf-876e-54fe81f498cf-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:03.625926 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:03.625895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj" event={"ID":"a16e0167-12f6-4ddf-876e-54fe81f498cf","Type":"ContainerDied","Data":"32bfd6058da35ac4732f6a51e65814b5269bf6cad33114f30c5a7cf1c8177801"}
Jul 06 20:21:03.625926 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:03.625916    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"
Jul 06 20:21:03.626451 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:03.625943    2581 scope.go:117] "RemoveContainer" containerID="9b7ea071e2851d9d6e631e96fcb48eda6b475ab2e1e9ca4bf0289689299b34e7"
Jul 06 20:21:03.662430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:03.662380    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"]
Jul 06 20:21:03.679393 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:03.679320    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a2e2cfb4/e2e-lifecycle-model-a2e2cfb4-kserve-58b8b6948c-sv8hj"]
Jul 06 20:21:05.023968 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:05.023934    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16e0167-12f6-4ddf-876e-54fe81f498cf" path="/var/lib/kubelet/pods/a16e0167-12f6-4ddf-876e-54fe81f498cf/volumes"
Jul 06 20:21:24.386327 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:24.386290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:24.829639 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:24.829610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:27.847961 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:27.847927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:21:30.638315 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:30.638280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:30.738974 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:30.738941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:30.925302 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:30.925210    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"]
Jul 06 20:21:30.925501 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:30.925459    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" containerID="cri-o://105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de" gracePeriod=30
Jul 06 20:21:30.945985 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:30.945952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:31.183489 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:31.183393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:32.290605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:32.290575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:32.472084 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:32.472053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:33.304912 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:33.304880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:33.388732 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:33.388691    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:34.898256 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:34.898219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:35.096319 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:35.096284    2581 patch_prober.go:28] interesting pod/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:21:35.096539 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:35.096343    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:21:36.186883 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.186814    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:21:36.233974 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.233941    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istiod-ca-cert\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234001    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-podinfo\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234027    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-envoy\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234044    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-data\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234071    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-socket\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8dth\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-kube-api-access-p8dth\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-certs\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-credential-socket\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-token\") pod \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\" (UID: \"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb\") "
Jul 06 20:21:36.234513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234446    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:21:36.234672 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234606    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.234672 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234575    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:36.234780 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234718    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:36.234843 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.234772    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:36.235469 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.235425    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:36.236663 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.236634    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:21:36.236753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.236678    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-kube-api-access-p8dth" (OuterVolumeSpecName: "kube-api-access-p8dth") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "kube-api-access-p8dth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:21:36.237281 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.237252    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:21:36.237281 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.237269    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" (UID: "cf92e2f6-466e-4f07-93e2-f1e410e7a3cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:21:36.335689 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335657    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8dth\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-kube-api-access-p8dth\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335689 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335684    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335689 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335694    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335704    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335713    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335720    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335728    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.335959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.335738    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:21:36.808295 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.808257    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerID="105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de" exitCode=0
Jul 06 20:21:36.808295 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.808296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" event={"ID":"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb","Type":"ContainerDied","Data":"105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de"}
Jul 06 20:21:36.808581 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.808313    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"
Jul 06 20:21:36.808581 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.808339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd" event={"ID":"cf92e2f6-466e-4f07-93e2-f1e410e7a3cb","Type":"ContainerDied","Data":"f11396abb9668ec7d19e8cd267b1b4049c3d0f162b6744088fb3196bcc5068b7"}
Jul 06 20:21:36.808581 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.808390    2581 scope.go:117] "RemoveContainer" containerID="105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de"
Jul 06 20:21:36.817973 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.817955    2581 scope.go:117] "RemoveContainer" containerID="58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"
Jul 06 20:21:36.826252 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.826230    2581 scope.go:117] "RemoveContainer" containerID="105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de"
Jul 06 20:21:36.826575 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:21:36.826557    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de\": container with ID starting with 105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de not found: ID does not exist" containerID="105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de"
Jul 06 20:21:36.826630 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.826583    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de"} err="failed to get container status \"105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de\": rpc error: code = NotFound desc = could not find container \"105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de\": container with ID starting with 105da780e96c0347d550877acc719e12bb2da4f7d7133a0765b68318d77a95de not found: ID does not exist"
Jul 06 20:21:36.826630 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.826600    2581 scope.go:117] "RemoveContainer" containerID="58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"
Jul 06 20:21:36.826871 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:21:36.826853    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f\": container with ID starting with 58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f not found: ID does not exist" containerID="58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"
Jul 06 20:21:36.826920 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.826879    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f"} err="failed to get container status \"58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f\": rpc error: code = NotFound desc = could not find container \"58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f\": container with ID starting with 58bc01a3b99eafda1cda5c36e749f238ff538942f5fbf22fca258757fda8b89f not found: ID does not exist"
Jul 06 20:21:36.832084 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.832059    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"]
Jul 06 20:21:36.838224 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:36.838192    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a2e2cfb4-openshift-default-85775777f5-4r5jd"]
Jul 06 20:21:37.024404 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:37.024347    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" path="/var/lib/kubelet/pods/cf92e2f6-466e-4f07-93e2-f1e410e7a3cb/volumes"
Jul 06 20:21:37.150585 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:37.150497    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:21:41.210396 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:41.210330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:41.317637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:41.317602    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:41.868742 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:41.868711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:48.485932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:48.485895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:48.590404 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:48.590374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:48.686555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:48.686496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:49.187971 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:49.187936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:21:59.204577 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:59.204525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:59.565806 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:21:59.565770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:20.563909 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:20.563867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:27.151438 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.151328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:27.254546 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.254509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:27.514972 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.514876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:27.843323 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.843288    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"]
Jul 06 20:22:27.843869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.843847    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16e0167-12f6-4ddf-876e-54fe81f498cf" containerName="main"
Jul 06 20:22:27.844046 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844030    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16e0167-12f6-4ddf-876e-54fe81f498cf" containerName="main"
Jul 06 20:22:27.844191 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844170    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy"
Jul 06 20:22:27.844191 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844190    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy"
Jul 06 20:22:27.844394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844203    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy"
Jul 06 20:22:27.844394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844212    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy"
Jul 06 20:22:27.844394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844310    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy"
Jul 06 20:22:27.844394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844323    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf92e2f6-466e-4f07-93e2-f1e410e7a3cb" containerName="istio-proxy"
Jul 06 20:22:27.844394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.844329    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16e0167-12f6-4ddf-876e-54fe81f498cf" containerName="main"
Jul 06 20:22:27.847427 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.847409    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.850663 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.850645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-efdc2b-openshift-default-dockercfg-glf6v\""
Jul 06 20:22:27.862886 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.862858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"]
Jul 06 20:22:27.901227 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.901183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:27.902463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7hp\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-kube-api-access-5s7hp\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902580 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-envoy\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902580 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-socket\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902580 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istiod-ca-cert\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-certs\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-credential-socket\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-token\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-podinfo\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:27.902866 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:27.902741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-data\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003285 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7hp\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-kube-api-access-5s7hp\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003285 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-envoy\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-socket\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istiod-ca-cert\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-certs\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-credential-socket\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-token\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-podinfo\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003611 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-data\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003972 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003785    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-socket\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.003972 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.003905    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-certs\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.004149 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.004095    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-data\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.004274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.004149    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-credential-socket\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.004339 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.004231    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istiod-ca-cert\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.005804 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.005782    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-envoy\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.006330 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.006306    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-podinfo\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.013551 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.013528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7hp\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-kube-api-access-5s7hp\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.017280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.017254    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-token\") pod \"e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") " pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.158207 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.158116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:28.267100 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.267070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:28.312165 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.312140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"]
Jul 06 20:22:28.314293 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:22:28.314261    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d882067_e9a9_49b8_9fab_fcf5b91ba290.slice/crio-eb338864d52a9b322621a8428aaf5d09f66eeadf27273f4865ba30f7b90ee985 WatchSource:0}: Error finding container eb338864d52a9b322621a8428aaf5d09f66eeadf27273f4865ba30f7b90ee985: Status 404 returned error can't find the container with id eb338864d52a9b322621a8428aaf5d09f66eeadf27273f4865ba30f7b90ee985
Jul 06 20:22:28.316379 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.316331    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:28.316458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.316425    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:28.316458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:28.316455    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:29.084652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:29.084613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" event={"ID":"3d882067-e9a9-49b8-9fab-fcf5b91ba290","Type":"ContainerStarted","Data":"5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"}
Jul 06 20:22:29.084868 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:29.084670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" event={"ID":"3d882067-e9a9-49b8-9fab-fcf5b91ba290","Type":"ContainerStarted","Data":"eb338864d52a9b322621a8428aaf5d09f66eeadf27273f4865ba30f7b90ee985"}
Jul 06 20:22:29.131105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:29.131051    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" podStartSLOduration=2.13103596 podStartE2EDuration="2.13103596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:22:29.130209484 +0000 UTC m=+1888.513868233" watchObservedRunningTime="2026-07-06 20:22:29.13103596 +0000 UTC m=+1888.514694708"
Jul 06 20:22:29.159270 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:29.159233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:29.164306 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:29.164283    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:30.090878 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:30.090846    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:30.091874 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:30.091855    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:31.129115 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:31.129081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:31.265874 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:31.265840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:31.373042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:31.373007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:31.473619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:31.473526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:31.978487 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:31.978445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:32.168539 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:32.168508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:35.680423 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:35.680355    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:35.987782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:35.987690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:36.289293 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.289200    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"]
Jul 06 20:22:36.292985 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.292969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.295555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.295535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f034b4-openshift-default-dockercfg-v8fqc\""
Jul 06 20:22:36.309881 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.309849    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"]
Jul 06 20:22:36.351197 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.351162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:36.366171 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-podinfo\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-token\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-envoy\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0536c50-0f7f-4223-883c-29242ddf2c29-istiod-ca-cert\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-socket\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366338 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bld\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-kube-api-access-z8bld\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-data\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-credential-socket\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.366571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.366428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-certs\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467392 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-podinfo\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467392 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-token\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-envoy\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0536c50-0f7f-4223-883c-29242ddf2c29-istiod-ca-cert\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-socket\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bld\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-kube-api-access-z8bld\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-data\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-credential-socket\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.467670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-certs\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.468023 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467898    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-socket\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.468023 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.467973    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-certs\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.468138 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.468098    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-credential-socket\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.468199 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.468142    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-data\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.468255 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.468238    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0536c50-0f7f-4223-883c-29242ddf2c29-istiod-ca-cert\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.470040 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.470007    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-envoy\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.470336 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.470321    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-podinfo\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.480063 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.480039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-token\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.480245 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.480224    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bld\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-kube-api-access-z8bld\") pod \"e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") " pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.585077 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.585036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:36.604058 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.604019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:36.765528 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.765502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"]
Jul 06 20:22:36.768711 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:22:36.768677    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0536c50_0f7f_4223_883c_29242ddf2c29.slice/crio-019472748cf146988ded4f1006573958462798c89e9de9ec6cd88a8b6722573d WatchSource:0}: Error finding container 019472748cf146988ded4f1006573958462798c89e9de9ec6cd88a8b6722573d: Status 404 returned error can't find the container with id 019472748cf146988ded4f1006573958462798c89e9de9ec6cd88a8b6722573d
Jul 06 20:22:36.773050 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.771687    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:36.773050 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.771771    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:36.773050 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:36.771809    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:37.131959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:37.131920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" event={"ID":"d0536c50-0f7f-4223-883c-29242ddf2c29","Type":"ContainerStarted","Data":"a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"}
Jul 06 20:22:37.132158 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:37.131992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" event={"ID":"d0536c50-0f7f-4223-883c-29242ddf2c29","Type":"ContainerStarted","Data":"019472748cf146988ded4f1006573958462798c89e9de9ec6cd88a8b6722573d"}
Jul 06 20:22:37.158171 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:37.158122    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podStartSLOduration=1.158105558 podStartE2EDuration="1.158105558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:22:37.155916486 +0000 UTC m=+1896.539575249" watchObservedRunningTime="2026-07-06 20:22:37.158105558 +0000 UTC m=+1896.541764307"
Jul 06 20:22:37.604567 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:37.604524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:37.609535 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:37.609507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:38.137248 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:38.137216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:38.138243 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:38.138224    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:38.839101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:38.839055    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:22:39.247257 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:39.247168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:39.403174 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:39.403139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:39.620752 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:39.620720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:40.159086 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:40.159056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:40.997023 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:40.996987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:41.164493 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:41.164453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:43.687057 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:43.687002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:46.132618 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:46.132570    2581 patch_prober.go:28] interesting pod/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:22:46.133127 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:46.132657    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:22:47.196115 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:47.196074    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerID="5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211" exitCode=0
Jul 06 20:22:47.196649 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:47.196219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" event={"ID":"3d882067-e9a9-49b8-9fab-fcf5b91ba290","Type":"ContainerDied","Data":"5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"}
Jul 06 20:22:47.196757 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:47.196735    2581 scope.go:117] "RemoveContainer" containerID="5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"
Jul 06 20:22:47.198332 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:47.198293    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:47.198450 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:47.198408    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:47.198516 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:47.198462    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:48.211797 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:48.211761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" event={"ID":"3d882067-e9a9-49b8-9fab-fcf5b91ba290","Type":"ContainerStarted","Data":"df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0"}
Jul 06 20:22:49.159016 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:49.158987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:49.159324 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:49.159306    2581 patch_prober.go:28] interesting pod/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:22:49.159553 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:49.159531    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 20:22:50.159255 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:50.159217    2581 patch_prober.go:28] interesting pod/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:22:50.159767 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:50.159741    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 20:22:51.159014 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:51.158985    2581 patch_prober.go:28] interesting pod/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:22:51.159261 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:51.159239    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 20:22:52.180181 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:52.180144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:52.180933 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:52.180855    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:52.181558 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:52.181532    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:22:52.678336 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:52.678288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:22:53.138497 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:53.138435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:53.253039 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:53.252994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:54.178583 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:54.178544    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:22:54.178801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:54.178608    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:22:55.261779 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:55.261746    2581 generic.go:356] "Generic (PLEG): container finished" podID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerID="a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c" exitCode=0
Jul 06 20:22:55.262231 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:55.261816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" event={"ID":"d0536c50-0f7f-4223-883c-29242ddf2c29","Type":"ContainerDied","Data":"a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"}
Jul 06 20:22:55.262231 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:55.262224    2581 scope.go:117] "RemoveContainer" containerID="a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"
Jul 06 20:22:55.263356 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:55.263319    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:55.263482 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:55.263444    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:55.263523 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:55.263497    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:22:56.269820 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:56.269790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" event={"ID":"d0536c50-0f7f-4223-883c-29242ddf2c29","Type":"ContainerStarted","Data":"1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273"}
Jul 06 20:22:56.604232 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:56.604187    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:22:56.604474 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:56.604439    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:22:56.604521 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:56.604500    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 06 20:22:57.604811 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:57.604771    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:22:57.605226 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:57.604843    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 06 20:22:58.604781 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:58.604741    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:22:58.604996 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:58.604823    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 06 20:22:59.605316 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:59.605273    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:22:59.605745 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:22:59.605329    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 06 20:23:00.608187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:00.608155    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:23:00.608583 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:00.608497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:23:00.609341 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:00.609323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:23:01.886335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:01.886276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:01.983773 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:01.983735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:12.870751 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.870716    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"]
Jul 06 20:23:12.874650 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.874622    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:12.878074 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.878049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-efdc2b\"/\"default-dockercfg-k99hq\""
Jul 06 20:23:12.878522 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.878495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-efdc2b\"/\"test-model-efdc2b-kserve-self-signed-certs\""
Jul 06 20:23:12.878643 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.878553    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-efdc2b\"/\"kube-root-ca.crt\""
Jul 06 20:23:12.878643 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.878553    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-efdc2b\"/\"openshift-service-ca.crt\""
Jul 06 20:23:12.886991 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.886961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"]
Jul 06 20:23:12.918339 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.918297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:12.945590 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.945555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-tmp-dir\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:12.945590 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.945594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-dshm\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:12.945875 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.945621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8047dcd-1014-4917-8eae-9b12e3071fed-tls-certs\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:12.945875 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.945692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-model-cache\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:12.945875 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.945766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-home\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:12.945875 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:12.945839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jbn\" (UniqueName: \"kubernetes.io/projected/b8047dcd-1014-4917-8eae-9b12e3071fed-kube-api-access-m5jbn\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046455 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jbn\" (UniqueName: \"kubernetes.io/projected/b8047dcd-1014-4917-8eae-9b12e3071fed-kube-api-access-m5jbn\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046680 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-tmp-dir\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046680 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-dshm\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046680 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8047dcd-1014-4917-8eae-9b12e3071fed-tls-certs\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046680 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-model-cache\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046680 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-home\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.046926 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.046903    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-tmp-dir\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.047060 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.047022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-model-cache\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.047060 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.047053    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-home\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.049044 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.049022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-dshm\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.049194 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.049178    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8047dcd-1014-4917-8eae-9b12e3071fed-tls-certs\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.055529 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.055506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jbn\" (UniqueName: \"kubernetes.io/projected/b8047dcd-1014-4917-8eae-9b12e3071fed-kube-api-access-m5jbn\") pod \"test-model-efdc2b-kserve-7ffb674f45-bpk6f\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") " pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.184835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.184744    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:13.343149 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.343118    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"]
Jul 06 20:23:13.345587 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:23:13.345556    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8047dcd_1014_4917_8eae_9b12e3071fed.slice/crio-42bb2f90edd18aa4033dc2bc7bceb3ef6533ee527de3b899f22ca49964f5786c WatchSource:0}: Error finding container 42bb2f90edd18aa4033dc2bc7bceb3ef6533ee527de3b899f22ca49964f5786c: Status 404 returned error can't find the container with id 42bb2f90edd18aa4033dc2bc7bceb3ef6533ee527de3b899f22ca49964f5786c
Jul 06 20:23:13.373148 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:13.373115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f" event={"ID":"b8047dcd-1014-4917-8eae-9b12e3071fed","Type":"ContainerStarted","Data":"42bb2f90edd18aa4033dc2bc7bceb3ef6533ee527de3b899f22ca49964f5786c"}
Jul 06 20:23:14.380033 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:14.379993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f" event={"ID":"b8047dcd-1014-4917-8eae-9b12e3071fed","Type":"ContainerStarted","Data":"3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3"}
Jul 06 20:23:14.399926 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:14.399814    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f" podStartSLOduration=2.399797037 podStartE2EDuration="2.399797037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:23:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:23:14.399171495 +0000 UTC m=+1933.782830243" watchObservedRunningTime="2026-07-06 20:23:14.399797037 +0000 UTC m=+1933.783455786"
Jul 06 20:23:16.154519 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:16.154480    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:23:23.185892 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:23.185851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:23.186524 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:23.185946    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:23.198716 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:23.198691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:23.442352 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:23.442261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:23:27.650747 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:27.650714    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:23:33.608675 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:23:33.608640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:26.190988 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.190950    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"]
Jul 06 20:24:26.194668 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.194647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.198556 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.198524    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f034b4\"/\"kube-root-ca.crt\""
Jul 06 20:24:26.199044 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.199017    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f034b4\"/\"test-model-f034b4-kserve-self-signed-certs\""
Jul 06 20:24:26.199188 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.199168    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f034b4\"/\"openshift-service-ca.crt\""
Jul 06 20:24:26.199705 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.199681    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f034b4\"/\"default-dockercfg-7bfvv\""
Jul 06 20:24:26.211846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.211809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"]
Jul 06 20:24:26.237482 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.237448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-home\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.237665 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.237487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tls-certs\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.237665 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.237556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbpv2\" (UniqueName: \"kubernetes.io/projected/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-kube-api-access-wbpv2\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.237665 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.237601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-dshm\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.237799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.237668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tmp-dir\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.237799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.237710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-model-cache\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.258542 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.258504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:26.338927 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.338894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-home\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.338927 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.338932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tls-certs\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.338962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbpv2\" (UniqueName: \"kubernetes.io/projected/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-kube-api-access-wbpv2\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.339086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-dshm\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.339145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tmp-dir\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339282 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.339169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-model-cache\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339417 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.339386    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-home\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339541 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.339526    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-model-cache\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.339598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.339557    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tmp-dir\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.341527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.341500    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-dshm\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.341790 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.341774    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tls-certs\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.349528 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.349496    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbpv2\" (UniqueName: \"kubernetes.io/projected/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-kube-api-access-wbpv2\") pod \"test-model-f034b4-kserve-68bfdd6c79-j2g6m\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") " pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.363194 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.363159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:26.461847 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.461743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:26.508062 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.508029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:26.668091 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.668052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"]
Jul 06 20:24:26.673674 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:24:26.673639    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b1a3ae4_c231_4fed_b8c2_8888574c5ada.slice/crio-c52314cfd49113584dbfd72ae463316b54ac917272a0efb988220706d3743aa9 WatchSource:0}: Error finding container c52314cfd49113584dbfd72ae463316b54ac917272a0efb988220706d3743aa9: Status 404 returned error can't find the container with id c52314cfd49113584dbfd72ae463316b54ac917272a0efb988220706d3743aa9
Jul 06 20:24:26.794518 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.794474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m" event={"ID":"3b1a3ae4-c231-4fed-b8c2-8888574c5ada","Type":"ContainerStarted","Data":"892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c"}
Jul 06 20:24:26.794722 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.794532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m" event={"ID":"3b1a3ae4-c231-4fed-b8c2-8888574c5ada","Type":"ContainerStarted","Data":"c52314cfd49113584dbfd72ae463316b54ac917272a0efb988220706d3743aa9"}
Jul 06 20:24:26.817032 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:26.816975    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m" podStartSLOduration=0.816957143 podStartE2EDuration="816.957143ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:26.813670697 +0000 UTC m=+2006.197329445" watchObservedRunningTime="2026-07-06 20:24:26.816957143 +0000 UTC m=+2006.200615901"
Jul 06 20:24:31.651889 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:31.651851    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:24:36.508532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:36.508485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:36.508532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:36.508545    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:36.521647 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:36.521614    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:36.860024 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:36.859991    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:24:44.022656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:44.022618    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"]
Jul 06 20:24:44.069870 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:44.069833    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:44.957250 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:44.957213    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"]
Jul 06 20:24:44.986973 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:44.986941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.171765 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:45.171718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.577565 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:45.577527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.759165 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:45.759129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.848577 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:45.848490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:46.064838 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:46.064775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:49.165459 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:49.165411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:24:50.635547 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:50.635508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:59.044000 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.043955    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f" podUID="b8047dcd-1014-4917-8eae-9b12e3071fed" containerName="main" containerID="cri-o://3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3" gracePeriod=45
Jul 06 20:24:59.315937 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.315905    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:24:59.367871 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.367835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5jbn\" (UniqueName: \"kubernetes.io/projected/b8047dcd-1014-4917-8eae-9b12e3071fed-kube-api-access-m5jbn\") pod \"b8047dcd-1014-4917-8eae-9b12e3071fed\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") "
Jul 06 20:24:59.367871 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.367872    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-home\") pod \"b8047dcd-1014-4917-8eae-9b12e3071fed\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") "
Jul 06 20:24:59.368137 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.367912    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-model-cache\") pod \"b8047dcd-1014-4917-8eae-9b12e3071fed\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") "
Jul 06 20:24:59.368137 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.367944    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-dshm\") pod \"b8047dcd-1014-4917-8eae-9b12e3071fed\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") "
Jul 06 20:24:59.368137 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8047dcd-1014-4917-8eae-9b12e3071fed-tls-certs\") pod \"b8047dcd-1014-4917-8eae-9b12e3071fed\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") "
Jul 06 20:24:59.368137 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-tmp-dir\") pod \"b8047dcd-1014-4917-8eae-9b12e3071fed\" (UID: \"b8047dcd-1014-4917-8eae-9b12e3071fed\") "
Jul 06 20:24:59.368337 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368193    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-home" (OuterVolumeSpecName: "home") pod "b8047dcd-1014-4917-8eae-9b12e3071fed" (UID: "b8047dcd-1014-4917-8eae-9b12e3071fed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:24:59.368337 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368226    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8047dcd-1014-4917-8eae-9b12e3071fed" (UID: "b8047dcd-1014-4917-8eae-9b12e3071fed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:24:59.368466 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368438    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:24:59.368466 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368442    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8047dcd-1014-4917-8eae-9b12e3071fed" (UID: "b8047dcd-1014-4917-8eae-9b12e3071fed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:24:59.368466 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.368458    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:24:59.370616 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.370576    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8047dcd-1014-4917-8eae-9b12e3071fed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8047dcd-1014-4917-8eae-9b12e3071fed" (UID: "b8047dcd-1014-4917-8eae-9b12e3071fed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:24:59.370750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.370695    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-dshm" (OuterVolumeSpecName: "dshm") pod "b8047dcd-1014-4917-8eae-9b12e3071fed" (UID: "b8047dcd-1014-4917-8eae-9b12e3071fed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:24:59.370750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.370707    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8047dcd-1014-4917-8eae-9b12e3071fed-kube-api-access-m5jbn" (OuterVolumeSpecName: "kube-api-access-m5jbn") pod "b8047dcd-1014-4917-8eae-9b12e3071fed" (UID: "b8047dcd-1014-4917-8eae-9b12e3071fed"). InnerVolumeSpecName "kube-api-access-m5jbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:24:59.469396 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.469331    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:24:59.469396 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.469390    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8047dcd-1014-4917-8eae-9b12e3071fed-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:24:59.469623 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.469424    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8047dcd-1014-4917-8eae-9b12e3071fed-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:24:59.469623 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.469434    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5jbn\" (UniqueName: \"kubernetes.io/projected/b8047dcd-1014-4917-8eae-9b12e3071fed-kube-api-access-m5jbn\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:24:59.979022 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.978986    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8047dcd-1014-4917-8eae-9b12e3071fed" containerID="3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3" exitCode=0
Jul 06 20:24:59.979243 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.979033    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"
Jul 06 20:24:59.979243 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.979077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f" event={"ID":"b8047dcd-1014-4917-8eae-9b12e3071fed","Type":"ContainerDied","Data":"3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3"}
Jul 06 20:24:59.979243 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.979124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f" event={"ID":"b8047dcd-1014-4917-8eae-9b12e3071fed","Type":"ContainerDied","Data":"42bb2f90edd18aa4033dc2bc7bceb3ef6533ee527de3b899f22ca49964f5786c"}
Jul 06 20:24:59.979243 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.979146    2581 scope.go:117] "RemoveContainer" containerID="3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3"
Jul 06 20:24:59.981116 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.981058    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m" podUID="3b1a3ae4-c231-4fed-b8c2-8888574c5ada" containerName="main" containerID="cri-o://892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c" gracePeriod=45
Jul 06 20:24:59.991866 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.991846    2581 scope.go:117] "RemoveContainer" containerID="3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3"
Jul 06 20:24:59.992188 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:24:59.992170    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3\": container with ID starting with 3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3 not found: ID does not exist" containerID="3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3"
Jul 06 20:24:59.992241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:24:59.992198    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3"} err="failed to get container status \"3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3\": rpc error: code = NotFound desc = could not find container \"3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3\": container with ID starting with 3e6e983eede922a142eb91e259d81b25af66342b9df21d1c7225b8bef75bb7f3 not found: ID does not exist"
Jul 06 20:25:00.011121 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.011082    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"]
Jul 06 20:25:00.021136 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.021108    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-efdc2b/test-model-efdc2b-kserve-7ffb674f45-bpk6f"]
Jul 06 20:25:00.244789 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.244718    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:25:00.378527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-dshm\") pod \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") "
Jul 06 20:25:00.378750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378555    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbpv2\" (UniqueName: \"kubernetes.io/projected/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-kube-api-access-wbpv2\") pod \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") "
Jul 06 20:25:00.378750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378664    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tmp-dir\") pod \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") "
Jul 06 20:25:00.378750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378703    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-model-cache\") pod \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") "
Jul 06 20:25:00.378750 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378730    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tls-certs\") pod \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") "
Jul 06 20:25:00.378986 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-home\") pod \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\" (UID: \"3b1a3ae4-c231-4fed-b8c2-8888574c5ada\") "
Jul 06 20:25:00.379042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.378998    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b1a3ae4-c231-4fed-b8c2-8888574c5ada" (UID: "3b1a3ae4-c231-4fed-b8c2-8888574c5ada"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:00.379042 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.379011    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b1a3ae4-c231-4fed-b8c2-8888574c5ada" (UID: "3b1a3ae4-c231-4fed-b8c2-8888574c5ada"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:00.379136 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.379117    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:00.379189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.379135    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:00.379270 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.379221    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-home" (OuterVolumeSpecName: "home") pod "3b1a3ae4-c231-4fed-b8c2-8888574c5ada" (UID: "3b1a3ae4-c231-4fed-b8c2-8888574c5ada"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:00.381039 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.381018    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-dshm" (OuterVolumeSpecName: "dshm") pod "3b1a3ae4-c231-4fed-b8c2-8888574c5ada" (UID: "3b1a3ae4-c231-4fed-b8c2-8888574c5ada"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:00.381141 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.381089    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-kube-api-access-wbpv2" (OuterVolumeSpecName: "kube-api-access-wbpv2") pod "3b1a3ae4-c231-4fed-b8c2-8888574c5ada" (UID: "3b1a3ae4-c231-4fed-b8c2-8888574c5ada"). InnerVolumeSpecName "kube-api-access-wbpv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:25:00.381294 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.381280    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b1a3ae4-c231-4fed-b8c2-8888574c5ada" (UID: "3b1a3ae4-c231-4fed-b8c2-8888574c5ada"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:25:00.479873 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.479837    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:00.479873 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.479866    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:00.479873 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.479874    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:00.479873 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.479882    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbpv2\" (UniqueName: \"kubernetes.io/projected/3b1a3ae4-c231-4fed-b8c2-8888574c5ada-kube-api-access-wbpv2\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:00.987130 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.987095    2581 generic.go:356] "Generic (PLEG): container finished" podID="3b1a3ae4-c231-4fed-b8c2-8888574c5ada" containerID="892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c" exitCode=0
Jul 06 20:25:00.987335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.987136    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"
Jul 06 20:25:00.987335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.987168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m" event={"ID":"3b1a3ae4-c231-4fed-b8c2-8888574c5ada","Type":"ContainerDied","Data":"892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c"}
Jul 06 20:25:00.987335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.987208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m" event={"ID":"3b1a3ae4-c231-4fed-b8c2-8888574c5ada","Type":"ContainerDied","Data":"c52314cfd49113584dbfd72ae463316b54ac917272a0efb988220706d3743aa9"}
Jul 06 20:25:00.987335 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.987225    2581 scope.go:117] "RemoveContainer" containerID="892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c"
Jul 06 20:25:00.997070 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.997050    2581 scope.go:117] "RemoveContainer" containerID="892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c"
Jul 06 20:25:00.997399 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:25:00.997351    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c\": container with ID starting with 892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c not found: ID does not exist" containerID="892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c"
Jul 06 20:25:00.997502 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:00.997407    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c"} err="failed to get container status \"892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c\": rpc error: code = NotFound desc = could not find container \"892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c\": container with ID starting with 892f7a1fed39b209069c13c6b35dfd947d68fd2a8f760bc2d84d0cd88e0ed72c not found: ID does not exist"
Jul 06 20:25:01.014139 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:01.014105    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"]
Jul 06 20:25:01.026137 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:01.026092    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8047dcd-1014-4917-8eae-9b12e3071fed" path="/var/lib/kubelet/pods/b8047dcd-1014-4917-8eae-9b12e3071fed/volumes"
Jul 06 20:25:01.026438 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:01.026422    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f034b4/test-model-f034b4-kserve-68bfdd6c79-j2g6m"]
Jul 06 20:25:03.013345 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:03.013305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:03.023893 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:03.023862    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b1a3ae4-c231-4fed-b8c2-8888574c5ada" path="/var/lib/kubelet/pods/3b1a3ae4-c231-4fed-b8c2-8888574c5ada/volumes"
Jul 06 20:25:27.984759 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:27.984680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:28.250554 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:28.250455    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"]
Jul 06 20:25:28.250715 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:28.250661    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy" containerID="cri-o://df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0" gracePeriod=30
Jul 06 20:25:28.283267 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:28.283224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:28.550768 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:28.550730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:28.730402 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:28.730347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:29.201107 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:29.201072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:29.475632 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:29.475542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:29.644665 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:29.644627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:29.884203 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:29.884162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:32.263068 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:32.263032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:25:33.524113 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.524044    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:25:33.586438 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-socket\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.586636 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586453    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-credential-socket\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.586636 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586496    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-podinfo\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.586636 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-envoy\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.586636 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-certs\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.586856 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586726    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s7hp\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-kube-api-access-5s7hp\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.586856 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586738    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:33.586856 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586779    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:33.587016 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586857    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istiod-ca-cert\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.587016 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586887    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-token\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.587016 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586941    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-data\") pod \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\" (UID: \"3d882067-e9a9-49b8-9fab-fcf5b91ba290\") "
Jul 06 20:25:33.587016 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.586973    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:33.587267 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.587207    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:25:33.587267 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.587240    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.587267 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.587261    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.587855 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.587275    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.588007 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.587986    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:33.589154 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.589124    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:25:33.589559 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.589442    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:25:33.589559 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.589445    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:33.589559 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.589533    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-kube-api-access-5s7hp" (OuterVolumeSpecName: "kube-api-access-5s7hp") pod "3d882067-e9a9-49b8-9fab-fcf5b91ba290" (UID: "3d882067-e9a9-49b8-9fab-fcf5b91ba290"). InnerVolumeSpecName "kube-api-access-5s7hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:25:33.688499 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.688462    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.688499 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.688494    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.688499 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.688503    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s7hp\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-kube-api-access-5s7hp\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.688753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.688512    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.688753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.688521    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:33.688753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:33.688529    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d882067-e9a9-49b8-9fab-fcf5b91ba290-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:34.177215 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.177180    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerID="df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0" exitCode=0
Jul 06 20:25:34.177456 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.177235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" event={"ID":"3d882067-e9a9-49b8-9fab-fcf5b91ba290","Type":"ContainerDied","Data":"df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0"}
Jul 06 20:25:34.177456 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.177249    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"
Jul 06 20:25:34.177456 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.177283    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s" event={"ID":"3d882067-e9a9-49b8-9fab-fcf5b91ba290","Type":"ContainerDied","Data":"eb338864d52a9b322621a8428aaf5d09f66eeadf27273f4865ba30f7b90ee985"}
Jul 06 20:25:34.177456 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.177311    2581 scope.go:117] "RemoveContainer" containerID="df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0"
Jul 06 20:25:34.189189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.189166    2581 scope.go:117] "RemoveContainer" containerID="5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"
Jul 06 20:25:34.198911 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.198885    2581 scope.go:117] "RemoveContainer" containerID="df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0"
Jul 06 20:25:34.199217 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:25:34.199198    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0\": container with ID starting with df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0 not found: ID does not exist" containerID="df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0"
Jul 06 20:25:34.199294 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.199234    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0"} err="failed to get container status \"df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0\": rpc error: code = NotFound desc = could not find container \"df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0\": container with ID starting with df23a2fe31fcc8a2840eb4a34b7d9dbd7272e1087ade9f45fff0d472c8c259c0 not found: ID does not exist"
Jul 06 20:25:34.199294 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.199261    2581 scope.go:117] "RemoveContainer" containerID="5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"
Jul 06 20:25:34.199569 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:25:34.199549    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211\": container with ID starting with 5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211 not found: ID does not exist" containerID="5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"
Jul 06 20:25:34.199617 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.199576    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211"} err="failed to get container status \"5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211\": rpc error: code = NotFound desc = could not find container \"5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211\": container with ID starting with 5108c93f9df45e9f282ca4225380b14bbf44ed0f788a9e4b139621b33897e211 not found: ID does not exist"
Jul 06 20:25:34.206639 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.206611    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"]
Jul 06 20:25:34.215412 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:34.215383    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-efdc2b-openshift-default-87bb84df-qp89s"]
Jul 06 20:25:35.024263 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:35.024221    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" path="/var/lib/kubelet/pods/3d882067-e9a9-49b8-9fab-fcf5b91ba290/volumes"
Jul 06 20:25:35.872324 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:35.872287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:35.986407 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:35.986346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:36.164889 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:36.164798    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"]
Jul 06 20:25:36.165356 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:36.165016    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy" containerID="cri-o://1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273" gracePeriod=30
Jul 06 20:25:36.194631 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:36.194574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:36.479723 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:36.479604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:36.958653 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:36.958598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:37.213245 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213158    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"]
Jul 06 20:25:37.213656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213581    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy"
Jul 06 20:25:37.213656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213593    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy"
Jul 06 20:25:37.213656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213607    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b1a3ae4-c231-4fed-b8c2-8888574c5ada" containerName="main"
Jul 06 20:25:37.213656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213612    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b1a3ae4-c231-4fed-b8c2-8888574c5ada" containerName="main"
Jul 06 20:25:37.213656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213655    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8047dcd-1014-4917-8eae-9b12e3071fed" containerName="main"
Jul 06 20:25:37.213840 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213660    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8047dcd-1014-4917-8eae-9b12e3071fed" containerName="main"
Jul 06 20:25:37.213840 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213724    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy"
Jul 06 20:25:37.213840 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213731    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b1a3ae4-c231-4fed-b8c2-8888574c5ada" containerName="main"
Jul 06 20:25:37.213840 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.213739    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8047dcd-1014-4917-8eae-9b12e3071fed" containerName="main"
Jul 06 20:25:37.218408 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.218389    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.226126 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.226104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-75489c-openshift-default-dockercfg-wsj6b\""
Jul 06 20:25:37.238423 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.238393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"]
Jul 06 20:25:37.332041 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-certs\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-credential-socket\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-envoy\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh48l\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-kube-api-access-zh48l\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-token\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332417 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-podinfo\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332417 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-socket\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332417 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-data\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.332417 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.332316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istiod-ca-cert\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.358436 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.358398    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:37.433705 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.433668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-certs\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.433903 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.433720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-credential-socket\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.433903 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.433740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-envoy\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.433903 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.433865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh48l\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-kube-api-access-zh48l\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.433916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-token\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.433976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-podinfo\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-socket\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-data\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istiod-ca-cert\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434101 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434087    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-certs\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434438 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434156    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-credential-socket\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434498 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-data\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434513    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-socket\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.434822 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.434799    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istiod-ca-cert\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.436155 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.436134    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-envoy\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.436473 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.436454    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-podinfo\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.451584 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.451546    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh48l\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-kube-api-access-zh48l\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.452570 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.452550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-token\") pod \"e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") " pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.528770 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.528678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:37.591080 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.591051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:37.690493 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.690465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"]
Jul 06 20:25:37.692651 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:25:37.692622    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd17a4b8_6ef3_415e_9884_7c32a860a12e.slice/crio-cf74947f49394251e508dd9e7dc2b279671063e7075402f16aab65fea1a65c99 WatchSource:0}: Error finding container cf74947f49394251e508dd9e7dc2b279671063e7075402f16aab65fea1a65c99: Status 404 returned error can't find the container with id cf74947f49394251e508dd9e7dc2b279671063e7075402f16aab65fea1a65c99
Jul 06 20:25:37.694910 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.694880    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:37.695052 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.695024    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:37.695125 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:37.695077    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:38.202295 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:38.202256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" event={"ID":"dd17a4b8-6ef3-415e-9884-7c32a860a12e","Type":"ContainerStarted","Data":"7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"}
Jul 06 20:25:38.202505 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:38.202318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" event={"ID":"dd17a4b8-6ef3-415e-9884-7c32a860a12e","Type":"ContainerStarted","Data":"cf74947f49394251e508dd9e7dc2b279671063e7075402f16aab65fea1a65c99"}
Jul 06 20:25:38.233696 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:38.233637    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podStartSLOduration=1.233617263 podStartE2EDuration="1.233617263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:38.2318983 +0000 UTC m=+2077.615557045" watchObservedRunningTime="2026-07-06 20:25:38.233617263 +0000 UTC m=+2077.617276134"
Jul 06 20:25:38.529571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:38.529475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:38.534690 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:38.534665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:39.208183 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:39.208145    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:39.209344 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:39.209325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:40.332048 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:40.332012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:40.453882 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:40.453849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:40.759017 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:40.758927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:41.016474 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.016344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:41.428792 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.428766    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:25:41.440076 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.440023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:41.474646 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474612    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8bld\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-kube-api-access-z8bld\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.474817 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474716    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-certs\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.474817 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474756    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-socket\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.474817 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474786    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-data\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.474817 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474814    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-envoy\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.475049 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474854    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-podinfo\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.475049 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-credential-socket\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.475049 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.474914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0536c50-0f7f-4223-883c-29242ddf2c29-istiod-ca-cert\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.475432 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.475338    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:41.475695 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.475676    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-token\") pod \"d0536c50-0f7f-4223-883c-29242ddf2c29\" (UID: \"d0536c50-0f7f-4223-883c-29242ddf2c29\") "
Jul 06 20:25:41.476220 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.476191    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:41.476307 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.476265    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:41.476602 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.476582    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.476715 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.476701    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.476817 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.476803    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.476908 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.476874    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:41.477232 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.477195    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0536c50-0f7f-4223-883c-29242ddf2c29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:25:41.477530 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.477488    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-kube-api-access-z8bld" (OuterVolumeSpecName: "kube-api-access-z8bld") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "kube-api-access-z8bld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:25:41.478296 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.478261    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:25:41.478910 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.478882    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:25:41.479595 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.479573    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0536c50-0f7f-4223-883c-29242ddf2c29" (UID: "d0536c50-0f7f-4223-883c-29242ddf2c29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:25:41.550031 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.549987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:41.578189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.578155    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.578189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.578187    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8bld\" (UniqueName: \"kubernetes.io/projected/d0536c50-0f7f-4223-883c-29242ddf2c29-kube-api-access-z8bld\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.578189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.578198    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.578513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.578207    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0536c50-0f7f-4223-883c-29242ddf2c29-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.578513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.578215    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0536c50-0f7f-4223-883c-29242ddf2c29-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:41.578513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:41.578223    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0536c50-0f7f-4223-883c-29242ddf2c29-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:25:42.226600 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.226568    2581 generic.go:356] "Generic (PLEG): container finished" podID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerID="1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273" exitCode=0
Jul 06 20:25:42.226782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.226632    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"
Jul 06 20:25:42.226782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.226636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" event={"ID":"d0536c50-0f7f-4223-883c-29242ddf2c29","Type":"ContainerDied","Data":"1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273"}
Jul 06 20:25:42.226782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.226699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m" event={"ID":"d0536c50-0f7f-4223-883c-29242ddf2c29","Type":"ContainerDied","Data":"019472748cf146988ded4f1006573958462798c89e9de9ec6cd88a8b6722573d"}
Jul 06 20:25:42.226782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.226730    2581 scope.go:117] "RemoveContainer" containerID="1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273"
Jul 06 20:25:42.236651 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.236628    2581 scope.go:117] "RemoveContainer" containerID="a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"
Jul 06 20:25:42.245864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.245843    2581 scope.go:117] "RemoveContainer" containerID="1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273"
Jul 06 20:25:42.246150 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:25:42.246129    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273\": container with ID starting with 1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273 not found: ID does not exist" containerID="1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273"
Jul 06 20:25:42.246219 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.246162    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273"} err="failed to get container status \"1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273\": rpc error: code = NotFound desc = could not find container \"1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273\": container with ID starting with 1b241e0f44cd1c66af29a3d690a9a0456035a12e32adb538436476146566d273 not found: ID does not exist"
Jul 06 20:25:42.246219 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.246189    2581 scope.go:117] "RemoveContainer" containerID="a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"
Jul 06 20:25:42.246491 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:25:42.246471    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c\": container with ID starting with a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c not found: ID does not exist" containerID="a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"
Jul 06 20:25:42.246546 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.246497    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c"} err="failed to get container status \"a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c\": rpc error: code = NotFound desc = could not find container \"a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c\": container with ID starting with a0df3a1a9ba0f7ea0c8851e8d44d069cba94809db90b8f4f23cb24729b02b39c not found: ID does not exist"
Jul 06 20:25:42.264321 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.264283    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"]
Jul 06 20:25:42.271159 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:42.271132    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f034b4-openshift-default-69968999b9-5l95m"]
Jul 06 20:25:43.023887 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:43.023851    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" path="/var/lib/kubelet/pods/d0536c50-0f7f-4223-883c-29242ddf2c29/volumes"
Jul 06 20:25:44.874865 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:44.874828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:45.357975 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.357932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:45.638425 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638327    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"]
Jul 06 20:25:45.638762 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638750    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy"
Jul 06 20:25:45.638805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638764    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy"
Jul 06 20:25:45.638805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638775    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy"
Jul 06 20:25:45.638805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638782    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy"
Jul 06 20:25:45.638805 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638803    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy"
Jul 06 20:25:45.638923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638809    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy"
Jul 06 20:25:45.638923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638883    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy"
Jul 06 20:25:45.638923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638892    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d882067-e9a9-49b8-9fab-fcf5b91ba290" containerName="istio-proxy"
Jul 06 20:25:45.638923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.638899    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0536c50-0f7f-4223-883c-29242ddf2c29" containerName="istio-proxy"
Jul 06 20:25:45.643659 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.643637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.649969 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.647064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3057cf-openshift-default-dockercfg-t8vb6\""
Jul 06 20:25:45.662518 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.662490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"]
Jul 06 20:25:45.717144 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-socket\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717351 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-data\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717351 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-envoy\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717351 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-token\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-certs\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-credential-socket\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc5mr\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-kube-api-access-fc5mr\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-podinfo\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.717716 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.717588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istiod-ca-cert\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.731144 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.731113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:45.818099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-data\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-envoy\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818410 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-token\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818410 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-certs\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818410 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-credential-socket\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818410 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc5mr\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-kube-api-access-fc5mr\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818410 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-podinfo\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818410 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istiod-ca-cert\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818708 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-socket\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818708 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818539    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-data\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818797 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818740    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-certs\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818797 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818758    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-socket\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.818904 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.818877    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-credential-socket\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.819397 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.819350    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istiod-ca-cert\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.820639 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.820622    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-envoy\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.821111 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.821088    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-podinfo\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.826904 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.826878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:25:45.830437 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.830413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc5mr\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-kube-api-access-fc5mr\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.830514 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.830467    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-token\") pod \"e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") " pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:45.959717 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:45.959623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:46.134579 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.134552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"]
Jul 06 20:25:46.136538 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:25:46.136511    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac86329_a95b_4222_a8f0_94e9fc4ea7f0.slice/crio-a16b0a893d37e0fe0c2f8599bf9a5387dd1800ee45623cb0e91374a8c616e19c WatchSource:0}: Error finding container a16b0a893d37e0fe0c2f8599bf9a5387dd1800ee45623cb0e91374a8c616e19c: Status 404 returned error can't find the container with id a16b0a893d37e0fe0c2f8599bf9a5387dd1800ee45623cb0e91374a8c616e19c
Jul 06 20:25:46.138622 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.138589    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:46.138694 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.138653    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:46.138694 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.138680    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:46.253606 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.253512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" event={"ID":"bac86329-a95b-4222-a8f0-94e9fc4ea7f0","Type":"ContainerStarted","Data":"e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"}
Jul 06 20:25:46.253606 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.253573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" event={"ID":"bac86329-a95b-4222-a8f0-94e9fc4ea7f0","Type":"ContainerStarted","Data":"a16b0a893d37e0fe0c2f8599bf9a5387dd1800ee45623cb0e91374a8c616e19c"}
Jul 06 20:25:46.264898 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.264855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:46.284408 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.284331    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" podStartSLOduration=1.284314443 podStartE2EDuration="1.284314443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:46.283074244 +0000 UTC m=+2085.666732994" watchObservedRunningTime="2026-07-06 20:25:46.284314443 +0000 UTC m=+2085.667973191"
Jul 06 20:25:46.960467 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:46.960433    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:47.966325 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:47.966295    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:48.265063 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:48.264978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:48.265893 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:48.265870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:25:48.468661 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:48.468624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:48.644341 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:48.644295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:48.908762 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:48.908671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:49.498253 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:49.498180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:49.599876 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:49.599842    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:52.878199 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:52.878163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:54.209992 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.209949    2581 patch_prober.go:28] interesting pod/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 06 20:25:54.210453 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.210020    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 06 20:25:54.307525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.307138    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerID="7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769" exitCode=0
Jul 06 20:25:54.307525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.307215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" event={"ID":"dd17a4b8-6ef3-415e-9884-7c32a860a12e","Type":"ContainerDied","Data":"7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"}
Jul 06 20:25:54.307798 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.307705    2581 scope.go:117] "RemoveContainer" containerID="7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"
Jul 06 20:25:54.309059 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.309029    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:54.309168 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.309120    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:54.309168 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:54.309164    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:25:55.318414 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:55.318341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" event={"ID":"dd17a4b8-6ef3-415e-9884-7c32a860a12e","Type":"ContainerStarted","Data":"766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8"}
Jul 06 20:25:55.529458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:55.529407    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:25:55.529763 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:55.529738    2581 patch_prober.go:28] interesting pod/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 06 20:25:55.529870 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:55.529802    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 06 20:25:56.529583 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:56.529543    2581 patch_prober.go:28] interesting pod/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 06 20:25:56.530124 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:56.529602    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 06 20:25:57.529180 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:57.529148    2581 patch_prober.go:28] interesting pod/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 06 20:25:57.529332 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:57.529228    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 06 20:25:58.529252 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:58.529212    2581 patch_prober.go:28] interesting pod/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 06 20:25:58.529638 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:58.529273    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 06 20:25:59.529858 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:59.529816    2581 patch_prober.go:28] interesting pod/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 06 20:25:59.530327 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:25:59.529890    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 06 20:26:00.533503 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:00.533467    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:26:00.533979 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:00.533852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:26:00.534468 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:00.534450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:26:01.156579 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:01.156550    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:26:01.160259 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:01.160237    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:26:01.413244 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:01.413174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:01.872293 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:01.872260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:02.271656 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.271572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:02.362430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.362396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" event={"ID":"bac86329-a95b-4222-a8f0-94e9fc4ea7f0","Type":"ContainerDied","Data":"e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"}
Jul 06 20:26:02.362430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.362356    2581 generic.go:356] "Generic (PLEG): container finished" podID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerID="e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07" exitCode=0
Jul 06 20:26:02.362815 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.362799    2581 scope.go:117] "RemoveContainer" containerID="e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"
Jul 06 20:26:02.363843 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.363813    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:02.363916 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.363898    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:02.363966 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.363950    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:02.434945 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.434901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:02.577825 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.577789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:26:02.652785 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:02.652755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:03.265215 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:03.265184    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:03.369952 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:03.369917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" event={"ID":"bac86329-a95b-4222-a8f0-94e9fc4ea7f0","Type":"ContainerStarted","Data":"9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18"}
Jul 06 20:26:03.960273 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:03.960237    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:03.961272 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:03.961246    2581 patch_prober.go:28] interesting pod/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 20:26:03.961404 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:03.961295    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 20:26:04.960414 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:04.960340    2581 patch_prober.go:28] interesting pod/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 20:26:04.960911 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:04.960459    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 20:26:05.960449 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:05.960411    2581 patch_prober.go:28] interesting pod/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 20:26:05.960848 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:05.960471    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 20:26:06.960983 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:06.960945    2581 patch_prober.go:28] interesting pod/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 20:26:06.961509 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:06.960999    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 20:26:07.963700 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:07.963668    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:07.964070 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:07.963941    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:07.964553 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:07.964535    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:08.349226 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:08.349193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:08.445852 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:08.445821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:08.660939 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:08.660843    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"]
Jul 06 20:26:08.661111 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:08.661042    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy" containerID="cri-o://766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8" gracePeriod=30
Jul 06 20:26:08.676649 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:08.676623    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:08.912545 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:08.912453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:09.215772 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:09.215699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:09.615055 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:09.615022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:09.856502 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:09.856468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:09.979423 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:09.979315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:10.328382 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:10.328329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:13.260071 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:13.260033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:26:13.922209 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:13.922148    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:26:14.004044 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-token\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004250 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004059    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-credential-socket\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004250 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-socket\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004250 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004117    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh48l\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-kube-api-access-zh48l\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-envoy\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004282    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-certs\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-podinfo\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istiod-ca-cert\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004463 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004416    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:14.004721 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004496    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:14.004721 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004510    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-data\") pod \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\" (UID: \"dd17a4b8-6ef3-415e-9884-7c32a860a12e\") "
Jul 06 20:26:14.004837 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.004762    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:14.005157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.005045    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.005157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.005109    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.005157 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.005124    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.005440 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.005281    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:14.005674 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.005647    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:14.006689 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.006666    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:14.006830 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.006677    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-kube-api-access-zh48l" (OuterVolumeSpecName: "kube-api-access-zh48l") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "kube-api-access-zh48l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:14.006830 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.006733    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:14.006925 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.006878    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd17a4b8-6ef3-415e-9884-7c32a860a12e" (UID: "dd17a4b8-6ef3-415e-9884-7c32a860a12e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:26:14.106047 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.105986    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.106047 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.106040    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.106047 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.106052    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.106353 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.106064    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.106353 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.106075    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh48l\" (UniqueName: \"kubernetes.io/projected/dd17a4b8-6ef3-415e-9884-7c32a860a12e-kube-api-access-zh48l\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.106353 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.106087    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd17a4b8-6ef3-415e-9884-7c32a860a12e-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:14.443653 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.443617    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerID="766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8" exitCode=0
Jul 06 20:26:14.444164 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.443666    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"
Jul 06 20:26:14.444164 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.443694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" event={"ID":"dd17a4b8-6ef3-415e-9884-7c32a860a12e","Type":"ContainerDied","Data":"766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8"}
Jul 06 20:26:14.444164 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.443755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd" event={"ID":"dd17a4b8-6ef3-415e-9884-7c32a860a12e","Type":"ContainerDied","Data":"cf74947f49394251e508dd9e7dc2b279671063e7075402f16aab65fea1a65c99"}
Jul 06 20:26:14.444164 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.443776    2581 scope.go:117] "RemoveContainer" containerID="766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8"
Jul 06 20:26:14.453476 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.453454    2581 scope.go:117] "RemoveContainer" containerID="7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"
Jul 06 20:26:14.464199 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.464179    2581 scope.go:117] "RemoveContainer" containerID="766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8"
Jul 06 20:26:14.464520 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:26:14.464499    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8\": container with ID starting with 766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8 not found: ID does not exist" containerID="766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8"
Jul 06 20:26:14.464574 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.464529    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8"} err="failed to get container status \"766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8\": rpc error: code = NotFound desc = could not find container \"766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8\": container with ID starting with 766cd8afb6999b0015bc27e0be195d4a333f0406d4ed6a6f9746de9412c906d8 not found: ID does not exist"
Jul 06 20:26:14.464574 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.464546    2581 scope.go:117] "RemoveContainer" containerID="7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"
Jul 06 20:26:14.464775 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:26:14.464757    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769\": container with ID starting with 7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769 not found: ID does not exist" containerID="7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"
Jul 06 20:26:14.464817 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.464783    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769"} err="failed to get container status \"7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769\": rpc error: code = NotFound desc = could not find container \"7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769\": container with ID starting with 7a2d689ed9affe2f319db05266d80dec4b8a12fa13665fa1098370f39a9dd769 not found: ID does not exist"
Jul 06 20:26:14.473192 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.473167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"]
Jul 06 20:26:14.477034 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:14.477010    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-75489c-openshift-default-d79d4bfb7-54ftd"]
Jul 06 20:26:15.023979 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:15.023943    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" path="/var/lib/kubelet/pods/dd17a4b8-6ef3-415e-9884-7c32a860a12e/volumes"
Jul 06 20:26:16.394835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:16.394797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:16.522963 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:16.522932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:16.757350 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:16.757260    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"]
Jul 06 20:26:16.757527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:16.757475    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy" containerID="cri-o://9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18" gracePeriod=30
Jul 06 20:26:16.839813 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:16.839782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:17.094431 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.094393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:17.379719 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.379631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:17.779907 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.779825    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"]
Jul 06 20:26:17.780264 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.780224    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy"
Jul 06 20:26:17.780264 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.780235    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy"
Jul 06 20:26:17.780333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.780320    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy"
Jul 06 20:26:17.780333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.780329    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy"
Jul 06 20:26:17.783642 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.783623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.787953 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.787920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-629470-openshift-default-dockercfg-w6f9b\""
Jul 06 20:26:17.823654 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.823622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"]
Jul 06 20:26:17.838556 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-token\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-socket\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-credential-socket\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838815 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istiod-ca-cert\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838815 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-podinfo\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838815 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5j4\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-kube-api-access-pk5j4\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838931 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-data\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838931 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-certs\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.838931 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.838911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-envoy\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.880767 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.880718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:17.939884 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-token\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-socket\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-credential-socket\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istiod-ca-cert\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-podinfo\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5j4\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-kube-api-access-pk5j4\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.939999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-data\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-certs\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940078 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-envoy\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940541 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940390    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-credential-socket\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940541 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940460    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-socket\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940541 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940519    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-data\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940707 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940634    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-certs\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.940836 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.940816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istiod-ca-cert\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.942670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.942652    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-envoy\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.942743 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.942727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-podinfo\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.961148 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.961114    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5j4\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-kube-api-access-pk5j4\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:17.965679 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:17.965656    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-token\") pod \"e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") " pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:18.056570 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.056532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:18.094520 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.094481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:18.270164 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.270135    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"]
Jul 06 20:26:18.272140 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:26:18.272104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a43f24_4e8a_4bdd_8229_e4220de4b6ee.slice/crio-4a8de8b81eedbf61c88c0d69d1c97bb325dbcf8e0fff1287c71b7ecdca21003a WatchSource:0}: Error finding container 4a8de8b81eedbf61c88c0d69d1c97bb325dbcf8e0fff1287c71b7ecdca21003a: Status 404 returned error can't find the container with id 4a8de8b81eedbf61c88c0d69d1c97bb325dbcf8e0fff1287c71b7ecdca21003a
Jul 06 20:26:18.274612 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.274576    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:18.274702 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.274647    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:18.274702 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.274679    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:18.470332 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.470287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" event={"ID":"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee","Type":"ContainerStarted","Data":"56da9c7e8f144da8e97e4bf7c830190be999eaf55bfe93f0a828eb7300a1a99e"}
Jul 06 20:26:18.470550 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.470387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" event={"ID":"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee","Type":"ContainerStarted","Data":"4a8de8b81eedbf61c88c0d69d1c97bb325dbcf8e0fff1287c71b7ecdca21003a"}
Jul 06 20:26:18.495319 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:18.495256    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podStartSLOduration=1.495234726 podStartE2EDuration="1.495234726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:18.494747197 +0000 UTC m=+2117.878405947" watchObservedRunningTime="2026-07-06 20:26:18.495234726 +0000 UTC m=+2117.878893475"
Jul 06 20:26:19.095489 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:19.095445    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:19.101324 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:19.101293    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:19.476641 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:19.476556    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:19.477841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:19.477821    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:20.667542 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:20.667505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:20.836415 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:20.836354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:20.985773 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:20.985675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:21.262827 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:21.262740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:21.786673 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:21.786643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:21.891725 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:21.891677    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:22.035129 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.035062    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:22.086743 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-credential-socket\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.086936 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086751    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-data\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.086936 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-token\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.086936 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-socket\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.086936 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-envoy\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.086936 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086868    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-certs\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.087218 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086938    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istiod-ca-cert\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.087218 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.086995    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-podinfo\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.087218 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087004    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:22.087218 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087034    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc5mr\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-kube-api-access-fc5mr\") pod \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\" (UID: \"bac86329-a95b-4222-a8f0-94e9fc4ea7f0\") "
Jul 06 20:26:22.087442 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087296    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:22.087442 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087358    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.087442 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087402    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:22.087587 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087525    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:22.087843 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.087792    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:22.089619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.089589    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:22.089862 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.089831    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:26:22.089955 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.089893    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:22.089999 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.089952    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-kube-api-access-fc5mr" (OuterVolumeSpecName: "kube-api-access-fc5mr") pod "bac86329-a95b-4222-a8f0-94e9fc4ea7f0" (UID: "bac86329-a95b-4222-a8f0-94e9fc4ea7f0"). InnerVolumeSpecName "kube-api-access-fc5mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:22.188275 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188234    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188275 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188268    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188275 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188277    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188275 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188287    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188662 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188297    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188662 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188308    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188662 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188322    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.188662 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.188332    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc5mr\" (UniqueName: \"kubernetes.io/projected/bac86329-a95b-4222-a8f0-94e9fc4ea7f0-kube-api-access-fc5mr\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:26:22.497059 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.497025    2581 generic.go:356] "Generic (PLEG): container finished" podID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerID="9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18" exitCode=0
Jul 06 20:26:22.497244 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.497082    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"
Jul 06 20:26:22.497244 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.497114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" event={"ID":"bac86329-a95b-4222-a8f0-94e9fc4ea7f0","Type":"ContainerDied","Data":"9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18"}
Jul 06 20:26:22.497244 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.497171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9" event={"ID":"bac86329-a95b-4222-a8f0-94e9fc4ea7f0","Type":"ContainerDied","Data":"a16b0a893d37e0fe0c2f8599bf9a5387dd1800ee45623cb0e91374a8c616e19c"}
Jul 06 20:26:22.497244 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.497193    2581 scope.go:117] "RemoveContainer" containerID="9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18"
Jul 06 20:26:22.507846 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.507825    2581 scope.go:117] "RemoveContainer" containerID="e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"
Jul 06 20:26:22.516867 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.516847    2581 scope.go:117] "RemoveContainer" containerID="9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18"
Jul 06 20:26:22.517133 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:26:22.517117    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18\": container with ID starting with 9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18 not found: ID does not exist" containerID="9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18"
Jul 06 20:26:22.517191 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.517142    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18"} err="failed to get container status \"9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18\": rpc error: code = NotFound desc = could not find container \"9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18\": container with ID starting with 9e5c05b97d12c98caabd4ad708d4b886959d51e424e6201fed2281c0d386ab18 not found: ID does not exist"
Jul 06 20:26:22.517191 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.517158    2581 scope.go:117] "RemoveContainer" containerID="e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"
Jul 06 20:26:22.517410 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:26:22.517391    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07\": container with ID starting with e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07 not found: ID does not exist" containerID="e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"
Jul 06 20:26:22.517460 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.517418    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07"} err="failed to get container status \"e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07\": rpc error: code = NotFound desc = could not find container \"e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07\": container with ID starting with e9b05d9b186248916dfb36baec3b7d4898685d47dbd659ee40cb391b848f5c07 not found: ID does not exist"
Jul 06 20:26:22.531960 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.531929    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"]
Jul 06 20:26:22.546682 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:22.546647    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3057cf-openshift-default-56cd8c94f7-qztr9"]
Jul 06 20:26:23.024194 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:23.024159    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" path="/var/lib/kubelet/pods/bac86329-a95b-4222-a8f0-94e9fc4ea7f0/volumes"
Jul 06 20:26:24.987300 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:24.987268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:25.354583 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.354549    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:25.703072 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.702989    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"]
Jul 06 20:26:25.703472 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703458    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy"
Jul 06 20:26:25.703533 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703473    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy"
Jul 06 20:26:25.703533 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703485    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy"
Jul 06 20:26:25.703533 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703490    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd17a4b8-6ef3-415e-9884-7c32a860a12e" containerName="istio-proxy"
Jul 06 20:26:25.703533 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703498    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy"
Jul 06 20:26:25.703533 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703504    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy"
Jul 06 20:26:25.703683 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703570    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy"
Jul 06 20:26:25.703683 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.703579    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac86329-a95b-4222-a8f0-94e9fc4ea7f0" containerName="istio-proxy"
Jul 06 20:26:25.708162 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.708143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.719265 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.719245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a90d79-openshift-default-dockercfg-vz4lx\""
Jul 06 20:26:25.727348 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.727320    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"]
Jul 06 20:26:25.779138 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.779094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:25.821223 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-credential-socket\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-data\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-token\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-socket\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-certs\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821454 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istiod-ca-cert\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821657 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-podinfo\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821657 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-envoy\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.821657 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.821570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5x9\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-kube-api-access-4k5x9\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923089 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-data\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923089 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-token\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-socket\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-certs\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istiod-ca-cert\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-podinfo\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-envoy\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5x9\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-kube-api-access-4k5x9\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-credential-socket\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923746 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923553    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-socket\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923746 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-data\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923746 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923720    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-certs\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.923874 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.923765    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-credential-socket\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.924017 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.924000    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istiod-ca-cert\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.925729 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.925707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-envoy\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.925940 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.925923    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-podinfo\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.942504 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.942477    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-token\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.942707 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.942685    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5x9\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-kube-api-access-4k5x9\") pod \"e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") " pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:25.958836 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:25.958758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:26.018281 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.018243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:26.195052 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.191871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"]
Jul 06 20:26:26.197029 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.196985    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:26.197268 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.197229    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:26.197405 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.197350    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:26.521787 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.521685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" event={"ID":"df223bf4-f76d-4c7a-a456-f7d6cb497e26","Type":"ContainerStarted","Data":"e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"}
Jul 06 20:26:26.521787 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.521756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" event={"ID":"df223bf4-f76d-4c7a-a456-f7d6cb497e26","Type":"ContainerStarted","Data":"43eaa20ddba2f833ef5f3d0731aed70305861948ee02ec4b8c2400602dccfeb6"}
Jul 06 20:26:26.571477 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:26.571411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podStartSLOduration=1.571389993 podStartE2EDuration="1.571389993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:26.571212227 +0000 UTC m=+2125.954870980" watchObservedRunningTime="2026-07-06 20:26:26.571389993 +0000 UTC m=+2125.955048735"
Jul 06 20:26:27.023662 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:27.023633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:27.024047 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:27.023986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:27.527270 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:27.527239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:27.528292 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:27.528275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:28.089099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:28.089068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:26:28.754836 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:28.754777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:28.976959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:28.976923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:29.317246 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:29.317213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:30.117555 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:30.117525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:30.277396 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:30.277326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:33.170152 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:33.170099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:34.076924 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:34.076864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:35.518610 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:35.518562    2581 patch_prober.go:28] interesting pod/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:26:35.519051 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:35.518691    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:26:36.577054 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:36.577021    2581 generic.go:356] "Generic (PLEG): container finished" podID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerID="56da9c7e8f144da8e97e4bf7c830190be999eaf55bfe93f0a828eb7300a1a99e" exitCode=0
Jul 06 20:26:36.577546 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:36.577103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" event={"ID":"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee","Type":"ContainerDied","Data":"56da9c7e8f144da8e97e4bf7c830190be999eaf55bfe93f0a828eb7300a1a99e"}
Jul 06 20:26:36.577680 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:36.577665    2581 scope.go:117] "RemoveContainer" containerID="56da9c7e8f144da8e97e4bf7c830190be999eaf55bfe93f0a828eb7300a1a99e"
Jul 06 20:26:36.578752 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:36.578723    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:36.578833 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:36.578792    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:36.578833 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:36.578822    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:37.588577 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:37.588542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" event={"ID":"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee","Type":"ContainerStarted","Data":"9b7b33d8fc11492fc9f40d9f3fad7347451d9e669c202fcef6be5a5e2dd033dc"}
Jul 06 20:26:38.094707 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:38.094667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:38.095384 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:38.095326    2581 patch_prober.go:28] interesting pod/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 06 20:26:38.095583 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:38.095557    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 06 20:26:39.096000 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:39.095951    2581 patch_prober.go:28] interesting pod/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 06 20:26:39.096536 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:39.096022    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 06 20:26:40.095650 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:40.095601    2581 patch_prober.go:28] interesting pod/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 06 20:26:40.095871 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:40.095693    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 06 20:26:41.095602 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:41.095567    2581 patch_prober.go:28] interesting pod/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 06 20:26:41.096584 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:41.096159    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 06 20:26:42.095566 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:42.095525    2581 patch_prober.go:28] interesting pod/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 06 20:26:42.095763 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:42.095586    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 06 20:26:42.152839 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:42.152800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:26:42.597991 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:42.597951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:42.697918 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:42.697883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:43.098789 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:43.098755    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:43.099237 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:43.099075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:43.099889 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:43.099872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:26:43.569533 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:43.569490    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:26:43.569722 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:43.569546    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:26:44.643695 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:44.643659    2581 generic.go:356] "Generic (PLEG): container finished" podID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerID="e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15" exitCode=0
Jul 06 20:26:44.644227 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:44.643732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" event={"ID":"df223bf4-f76d-4c7a-a456-f7d6cb497e26","Type":"ContainerDied","Data":"e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"}
Jul 06 20:26:44.644314 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:44.644255    2581 scope.go:117] "RemoveContainer" containerID="e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"
Jul 06 20:26:44.645200 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:44.645175    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:44.645282 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:44.645238    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:44.645282 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:44.645268    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 06 20:26:45.651404 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:45.651354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" event={"ID":"df223bf4-f76d-4c7a-a456-f7d6cb497e26","Type":"ContainerStarted","Data":"4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd"}
Jul 06 20:26:46.019490 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:46.019387    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:46.019658 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:46.019622    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 20:26:46.019705 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:46.019667    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 20:26:47.018892 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:47.018857    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 20:26:47.019287 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:47.018921    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 20:26:48.019112 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:48.019071    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 20:26:48.019537 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:48.019131    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 20:26:49.018837 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:49.018800    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 20:26:49.019015 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:49.018855    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 20:26:50.022168 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:50.022138    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:50.022675 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:50.022474    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:50.023165 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:50.023147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:26:51.430409 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:51.430317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:51.676070 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:51.676037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:56.852844 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.852810    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"]
Jul 06 20:26:56.857510 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.857491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.875180 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.875151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"openshift-service-ca.crt\""
Jul 06 20:26:56.876812 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.876793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"auth-test-model-629470-kserve-self-signed-certs\""
Jul 06 20:26:56.897158 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.897125    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"kube-root-ca.crt\""
Jul 06 20:26:56.897300 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.897179    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"default-dockercfg-xjzj8\""
Jul 06 20:26:56.935932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.935586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-home\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.935932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.935657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljj6m\" (UniqueName: \"kubernetes.io/projected/ce949d96-271b-4bee-a658-48392cf6154c-kube-api-access-ljj6m\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.935932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.935688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-dshm\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.935932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.935754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-tmp-dir\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.935932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.935790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-model-cache\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.935932 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.935843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce949d96-271b-4bee-a658-48392cf6154c-tls-certs\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:56.959052 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:56.959011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:57.036426 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljj6m\" (UniqueName: \"kubernetes.io/projected/ce949d96-271b-4bee-a658-48392cf6154c-kube-api-access-ljj6m\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.036619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-dshm\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.036619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-tmp-dir\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.036619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-model-cache\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.036619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce949d96-271b-4bee-a658-48392cf6154c-tls-certs\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.036827 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-home\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.036993 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036973    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-tmp-dir\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.037064 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.036989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-model-cache\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.037064 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.037012    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-home\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.038843 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.038823    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-dshm\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.039511 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.039493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce949d96-271b-4bee-a658-48392cf6154c-tls-certs\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.079601 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.079571    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljj6m\" (UniqueName: \"kubernetes.io/projected/ce949d96-271b-4bee-a658-48392cf6154c-kube-api-access-ljj6m\") pod \"auth-test-model-629470-kserve-bdb8779-n5w96\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") " pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.137774 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.137678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"]
Jul 06 20:26:57.166474 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.166436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:26:57.414021 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.413930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"]
Jul 06 20:26:57.423991 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:26:57.423964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce949d96_271b_4bee_a658_48392cf6154c.slice/crio-967c7e8266f9449f67f29c6d0c73929b23445fca0defa3cb25cd06836f1056a5 WatchSource:0}: Error finding container 967c7e8266f9449f67f29c6d0c73929b23445fca0defa3cb25cd06836f1056a5: Status 404 returned error can't find the container with id 967c7e8266f9449f67f29c6d0c73929b23445fca0defa3cb25cd06836f1056a5
Jul 06 20:26:57.721109 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.721019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96" event={"ID":"ce949d96-271b-4bee-a658-48392cf6154c","Type":"ContainerStarted","Data":"68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733"}
Jul 06 20:26:57.721109 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.721058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96" event={"ID":"ce949d96-271b-4bee-a658-48392cf6154c","Type":"ContainerStarted","Data":"967c7e8266f9449f67f29c6d0c73929b23445fca0defa3cb25cd06836f1056a5"}
Jul 06 20:26:57.763485 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:26:57.763433    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96" podStartSLOduration=1.7634160030000001 podStartE2EDuration="1.763416003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:57.762148366 +0000 UTC m=+2157.145807139" watchObservedRunningTime="2026-07-06 20:26:57.763416003 +0000 UTC m=+2157.147074753"
Jul 06 20:27:00.512250 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:00.512209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:27:07.166810 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:07.166778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:27:07.167302 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:07.166827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:27:07.181880 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:07.181851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:27:07.784234 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:07.784203    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:27:25.412103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.412064    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"]
Jul 06 20:27:25.415753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.415735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.420931 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.420892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"auth-test-model-a90d79-kserve-self-signed-certs\""
Jul 06 20:27:25.421394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.421378    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"openshift-service-ca.crt\""
Jul 06 20:27:25.421527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.421476    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"kube-root-ca.crt\""
Jul 06 20:27:25.421527 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.421491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"default-dockercfg-t4mlj\""
Jul 06 20:27:25.449701 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.449664    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"]
Jul 06 20:27:25.489730 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.489689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:25.513260 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.513230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-tmp-dir\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.513460 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.513384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-home\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.513460 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.513432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-dshm\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.513589 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.513459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdzvr\" (UniqueName: \"kubernetes.io/projected/9471a230-7a31-495b-b2cb-a26be6b23ab9-kube-api-access-mdzvr\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.513589 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.513484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-model-cache\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.513589 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.513523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9471a230-7a31-495b-b2cb-a26be6b23ab9-tls-certs\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615036 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-home\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615036 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-dshm\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615258 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdzvr\" (UniqueName: \"kubernetes.io/projected/9471a230-7a31-495b-b2cb-a26be6b23ab9-kube-api-access-mdzvr\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615258 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-model-cache\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615258 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9471a230-7a31-495b-b2cb-a26be6b23ab9-tls-certs\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615466 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-tmp-dir\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615481    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-home\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615663 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615631    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-model-cache\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.615773 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.615707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-tmp-dir\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.617620 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.617598    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-dshm\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.617882 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.617864    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9471a230-7a31-495b-b2cb-a26be6b23ab9-tls-certs\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.628677 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.628654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdzvr\" (UniqueName: \"kubernetes.io/projected/9471a230-7a31-495b-b2cb-a26be6b23ab9-kube-api-access-mdzvr\") pod \"auth-test-model-a90d79-kserve-699b4d795f-22kz4\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") " pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.726418 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.726312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:25.897910 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:27:25.897880    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9471a230_7a31_495b_b2cb_a26be6b23ab9.slice/crio-48a8437377e01dc3d48e3ef145ce7a4a440baf27105bab1f5de6c7bd4031e5f4 WatchSource:0}: Error finding container 48a8437377e01dc3d48e3ef145ce7a4a440baf27105bab1f5de6c7bd4031e5f4: Status 404 returned error can't find the container with id 48a8437377e01dc3d48e3ef145ce7a4a440baf27105bab1f5de6c7bd4031e5f4
Jul 06 20:27:25.903962 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:25.903940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"]
Jul 06 20:27:26.877783 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:26.877748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4" event={"ID":"9471a230-7a31-495b-b2cb-a26be6b23ab9","Type":"ContainerStarted","Data":"2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6"}
Jul 06 20:27:26.877783 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:26.877786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4" event={"ID":"9471a230-7a31-495b-b2cb-a26be6b23ab9","Type":"ContainerStarted","Data":"48a8437377e01dc3d48e3ef145ce7a4a440baf27105bab1f5de6c7bd4031e5f4"}
Jul 06 20:27:26.923995 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:26.923943    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4" podStartSLOduration=1.9239268200000001 podStartE2EDuration="1.92392682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:27:26.922654887 +0000 UTC m=+2186.306313637" watchObservedRunningTime="2026-07-06 20:27:26.92392682 +0000 UTC m=+2186.307585568"
Jul 06 20:27:29.388408 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:29.388356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:27:35.727148 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:35.727115    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:35.727765 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:35.727165    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:35.739893 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:35.739870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:35.940525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:35.940496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:27:47.923191 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:27:47.923158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:28:05.200159 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:28:05.200113    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:28:21.594838 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:28:21.594758    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:28:33.302131 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:28:33.302099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:28:41.838732 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:28:41.838697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:28:50.356655 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:28:50.356613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:28:57.153342 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:28:57.153308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:03.433683 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:03.433643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:29:08.404599 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:08.404561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:19.927556 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:19.927519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:20.170944 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:20.170900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:20.189684 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:20.189602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:29:27.536088 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:27.536041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:27.764049 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:27.764015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:35.700106 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:35.700068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:29:47.689025 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:47.688985    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"]
Jul 06 20:29:47.740920 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:47.740887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:48.657595 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:48.657559    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"]
Jul 06 20:29:48.703853 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:48.703819    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:51.397768 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:51.397686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:29:56.742942 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.742907    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"]
Jul 06 20:29:56.746670 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.746646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:56.748937 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.748915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"sub-test-model-629470-kserve-self-signed-certs\""
Jul 06 20:29:56.800917 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.800885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"]
Jul 06 20:29:56.851605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.851571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:56.912274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.912236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-tmp-dir\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:56.912506 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.912408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-dshm\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:56.912506 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.912479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-model-cache\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:56.912623 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.912571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-home\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:56.912681 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.912631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e255f026-022f-449f-99b7-a0d3d6e16d51-tls-certs\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:56.912735 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:56.912677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prc24\" (UniqueName: \"kubernetes.io/projected/e255f026-022f-449f-99b7-a0d3d6e16d51-kube-api-access-prc24\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013431 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-tmp-dir\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013431 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-dshm\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013694 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-model-cache\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013694 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-home\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013694 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e255f026-022f-449f-99b7-a0d3d6e16d51-tls-certs\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013694 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prc24\" (UniqueName: \"kubernetes.io/projected/e255f026-022f-449f-99b7-a0d3d6e16d51-kube-api-access-prc24\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013884 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013783    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-tmp-dir\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013924 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-home\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.013980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.013949    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-model-cache\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.015892 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.015869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-dshm\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.016170 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.016149    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e255f026-022f-449f-99b7-a0d3d6e16d51-tls-certs\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.028450 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.028424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prc24\" (UniqueName: \"kubernetes.io/projected/e255f026-022f-449f-99b7-a0d3d6e16d51-kube-api-access-prc24\") pod \"sub-test-model-629470-kserve-789b6fbf9-fcfzn\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") " pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.055781 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.055742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:29:57.230502 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.230469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"]
Jul 06 20:29:57.233622 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:29:57.233594    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode255f026_022f_449f_99b7_a0d3d6e16d51.slice/crio-99a77391541d0217acfcded9963214168cf701932c94a6f4f3985d9a97ca4896 WatchSource:0}: Error finding container 99a77391541d0217acfcded9963214168cf701932c94a6f4f3985d9a97ca4896: Status 404 returned error can't find the container with id 99a77391541d0217acfcded9963214168cf701932c94a6f4f3985d9a97ca4896
Jul 06 20:29:57.717851 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.717812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn" event={"ID":"e255f026-022f-449f-99b7-a0d3d6e16d51","Type":"ContainerStarted","Data":"4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c"}
Jul 06 20:29:57.718024 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.717861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn" event={"ID":"e255f026-022f-449f-99b7-a0d3d6e16d51","Type":"ContainerStarted","Data":"99a77391541d0217acfcded9963214168cf701932c94a6f4f3985d9a97ca4896"}
Jul 06 20:29:57.752933 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:29:57.752877    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn" podStartSLOduration=1.752860426 podStartE2EDuration="1.752860426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:29:57.750395173 +0000 UTC m=+2337.134053922" watchObservedRunningTime="2026-07-06 20:29:57.752860426 +0000 UTC m=+2337.136519175"
Jul 06 20:30:02.712439 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:02.712354    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96" podUID="ce949d96-271b-4bee-a658-48392cf6154c" containerName="main" containerID="cri-o://68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733" gracePeriod=45
Jul 06 20:30:02.980210 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:02.980184    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:30:03.072127 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072072    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce949d96-271b-4bee-a658-48392cf6154c-tls-certs\") pod \"ce949d96-271b-4bee-a658-48392cf6154c\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") "
Jul 06 20:30:03.072342 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-home\") pod \"ce949d96-271b-4bee-a658-48392cf6154c\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") "
Jul 06 20:30:03.072342 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-dshm\") pod \"ce949d96-271b-4bee-a658-48392cf6154c\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") "
Jul 06 20:30:03.072342 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljj6m\" (UniqueName: \"kubernetes.io/projected/ce949d96-271b-4bee-a658-48392cf6154c-kube-api-access-ljj6m\") pod \"ce949d96-271b-4bee-a658-48392cf6154c\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") "
Jul 06 20:30:03.072342 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072279    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-model-cache\") pod \"ce949d96-271b-4bee-a658-48392cf6154c\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") "
Jul 06 20:30:03.072651 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072348    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-tmp-dir\") pod \"ce949d96-271b-4bee-a658-48392cf6154c\" (UID: \"ce949d96-271b-4bee-a658-48392cf6154c\") "
Jul 06 20:30:03.072651 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072596    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce949d96-271b-4bee-a658-48392cf6154c" (UID: "ce949d96-271b-4bee-a658-48392cf6154c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.072768 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072708    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce949d96-271b-4bee-a658-48392cf6154c" (UID: "ce949d96-271b-4bee-a658-48392cf6154c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.072918 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072854    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.072918 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.072876    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.073161 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.073138    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-home" (OuterVolumeSpecName: "home") pod "ce949d96-271b-4bee-a658-48392cf6154c" (UID: "ce949d96-271b-4bee-a658-48392cf6154c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.074831 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.074802    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-dshm" (OuterVolumeSpecName: "dshm") pod "ce949d96-271b-4bee-a658-48392cf6154c" (UID: "ce949d96-271b-4bee-a658-48392cf6154c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.075001 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.074980    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce949d96-271b-4bee-a658-48392cf6154c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce949d96-271b-4bee-a658-48392cf6154c" (UID: "ce949d96-271b-4bee-a658-48392cf6154c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:30:03.075801 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.075781    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce949d96-271b-4bee-a658-48392cf6154c-kube-api-access-ljj6m" (OuterVolumeSpecName: "kube-api-access-ljj6m") pod "ce949d96-271b-4bee-a658-48392cf6154c" (UID: "ce949d96-271b-4bee-a658-48392cf6154c"). InnerVolumeSpecName "kube-api-access-ljj6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:30:03.174425 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.174390    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce949d96-271b-4bee-a658-48392cf6154c-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.174425 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.174418    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.174425 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.174426    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce949d96-271b-4bee-a658-48392cf6154c-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.174425 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.174434    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljj6m\" (UniqueName: \"kubernetes.io/projected/ce949d96-271b-4bee-a658-48392cf6154c-kube-api-access-ljj6m\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.679654 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.679615    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4" podUID="9471a230-7a31-495b-b2cb-a26be6b23ab9" containerName="main" containerID="cri-o://2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6" gracePeriod=45
Jul 06 20:30:03.754520 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.754480    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce949d96-271b-4bee-a658-48392cf6154c" containerID="68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733" exitCode=0
Jul 06 20:30:03.754970 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.754533    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"
Jul 06 20:30:03.754970 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.754558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96" event={"ID":"ce949d96-271b-4bee-a658-48392cf6154c","Type":"ContainerDied","Data":"68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733"}
Jul 06 20:30:03.754970 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.754605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96" event={"ID":"ce949d96-271b-4bee-a658-48392cf6154c","Type":"ContainerDied","Data":"967c7e8266f9449f67f29c6d0c73929b23445fca0defa3cb25cd06836f1056a5"}
Jul 06 20:30:03.754970 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.754624    2581 scope.go:117] "RemoveContainer" containerID="68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733"
Jul 06 20:30:03.789517 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.789484    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"]
Jul 06 20:30:03.792742 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.792715    2581 scope.go:117] "RemoveContainer" containerID="68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733"
Jul 06 20:30:03.793103 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:30:03.793080    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733\": container with ID starting with 68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733 not found: ID does not exist" containerID="68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733"
Jul 06 20:30:03.793205 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.793113    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733"} err="failed to get container status \"68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733\": rpc error: code = NotFound desc = could not find container \"68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733\": container with ID starting with 68549bbfdc8e2bf642ac3d3421968c910f8a433acca3f9a9a10c17ae74b13733 not found: ID does not exist"
Jul 06 20:30:03.796686 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.796662    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-629470/auth-test-model-629470-kserve-bdb8779-n5w96"]
Jul 06 20:30:03.951809 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.951778    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:30:03.981207 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981169    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-tmp-dir\") pod \"9471a230-7a31-495b-b2cb-a26be6b23ab9\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") "
Jul 06 20:30:03.981403 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-home\") pod \"9471a230-7a31-495b-b2cb-a26be6b23ab9\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") "
Jul 06 20:30:03.981403 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981248    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-dshm\") pod \"9471a230-7a31-495b-b2cb-a26be6b23ab9\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") "
Jul 06 20:30:03.981403 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9471a230-7a31-495b-b2cb-a26be6b23ab9-tls-certs\") pod \"9471a230-7a31-495b-b2cb-a26be6b23ab9\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") "
Jul 06 20:30:03.981403 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981356    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdzvr\" (UniqueName: \"kubernetes.io/projected/9471a230-7a31-495b-b2cb-a26be6b23ab9-kube-api-access-mdzvr\") pod \"9471a230-7a31-495b-b2cb-a26be6b23ab9\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") "
Jul 06 20:30:03.981612 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-model-cache\") pod \"9471a230-7a31-495b-b2cb-a26be6b23ab9\" (UID: \"9471a230-7a31-495b-b2cb-a26be6b23ab9\") "
Jul 06 20:30:03.981612 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981558    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-home" (OuterVolumeSpecName: "home") pod "9471a230-7a31-495b-b2cb-a26be6b23ab9" (UID: "9471a230-7a31-495b-b2cb-a26be6b23ab9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.981612 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981572    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9471a230-7a31-495b-b2cb-a26be6b23ab9" (UID: "9471a230-7a31-495b-b2cb-a26be6b23ab9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.981824 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981800    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.981876 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.981834    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.982451 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.982421    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-model-cache" (OuterVolumeSpecName: "model-cache") pod "9471a230-7a31-495b-b2cb-a26be6b23ab9" (UID: "9471a230-7a31-495b-b2cb-a26be6b23ab9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.983917 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.983892    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-dshm" (OuterVolumeSpecName: "dshm") pod "9471a230-7a31-495b-b2cb-a26be6b23ab9" (UID: "9471a230-7a31-495b-b2cb-a26be6b23ab9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.984040 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.983929    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9471a230-7a31-495b-b2cb-a26be6b23ab9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9471a230-7a31-495b-b2cb-a26be6b23ab9" (UID: "9471a230-7a31-495b-b2cb-a26be6b23ab9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:30:03.984150 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:03.984129    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9471a230-7a31-495b-b2cb-a26be6b23ab9-kube-api-access-mdzvr" (OuterVolumeSpecName: "kube-api-access-mdzvr") pod "9471a230-7a31-495b-b2cb-a26be6b23ab9" (UID: "9471a230-7a31-495b-b2cb-a26be6b23ab9"). InnerVolumeSpecName "kube-api-access-mdzvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:30:04.083183 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.083145    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:04.083183 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.083178    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9471a230-7a31-495b-b2cb-a26be6b23ab9-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:04.083183 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.083190    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdzvr\" (UniqueName: \"kubernetes.io/projected/9471a230-7a31-495b-b2cb-a26be6b23ab9-kube-api-access-mdzvr\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:04.083470 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.083199    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9471a230-7a31-495b-b2cb-a26be6b23ab9-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:30:04.761625 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.761590    2581 generic.go:356] "Generic (PLEG): container finished" podID="9471a230-7a31-495b-b2cb-a26be6b23ab9" containerID="2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6" exitCode=0
Jul 06 20:30:04.762108 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.761654    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"
Jul 06 20:30:04.762108 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.761684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4" event={"ID":"9471a230-7a31-495b-b2cb-a26be6b23ab9","Type":"ContainerDied","Data":"2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6"}
Jul 06 20:30:04.762108 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.761727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4" event={"ID":"9471a230-7a31-495b-b2cb-a26be6b23ab9","Type":"ContainerDied","Data":"48a8437377e01dc3d48e3ef145ce7a4a440baf27105bab1f5de6c7bd4031e5f4"}
Jul 06 20:30:04.762108 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.761751    2581 scope.go:117] "RemoveContainer" containerID="2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6"
Jul 06 20:30:04.771851 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.771831    2581 scope.go:117] "RemoveContainer" containerID="2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6"
Jul 06 20:30:04.772154 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:30:04.772134    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6\": container with ID starting with 2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6 not found: ID does not exist" containerID="2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6"
Jul 06 20:30:04.772203 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.772163    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6"} err="failed to get container status \"2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6\": rpc error: code = NotFound desc = could not find container \"2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6\": container with ID starting with 2ab8c7356a8eb14f2737d0eedcbffd0a8b1974927a41bd63c39827cbf147ebd6 not found: ID does not exist"
Jul 06 20:30:04.789966 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.789933    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"]
Jul 06 20:30:04.794087 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:04.794058    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/auth-test-model-a90d79-kserve-699b4d795f-22kz4"]
Jul 06 20:30:05.024500 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:05.024399    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9471a230-7a31-495b-b2cb-a26be6b23ab9" path="/var/lib/kubelet/pods/9471a230-7a31-495b-b2cb-a26be6b23ab9/volumes"
Jul 06 20:30:05.024888 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:05.024870    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce949d96-271b-4bee-a658-48392cf6154c" path="/var/lib/kubelet/pods/ce949d96-271b-4bee-a658-48392cf6154c/volumes"
Jul 06 20:30:07.056286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:07.056238    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:30:07.056286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:07.056281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:30:07.068815 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:07.068785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:30:07.792774 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:07.792739    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:30:07.979785 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:07.979748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:30:13.767415 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.767374    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"]
Jul 06 20:30:13.768012 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.767999    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9471a230-7a31-495b-b2cb-a26be6b23ab9" containerName="main"
Jul 06 20:30:13.768083 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.768019    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9471a230-7a31-495b-b2cb-a26be6b23ab9" containerName="main"
Jul 06 20:30:13.768083 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.768050    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce949d96-271b-4bee-a658-48392cf6154c" containerName="main"
Jul 06 20:30:13.768083 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.768059    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce949d96-271b-4bee-a658-48392cf6154c" containerName="main"
Jul 06 20:30:13.768238 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.768174    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce949d96-271b-4bee-a658-48392cf6154c" containerName="main"
Jul 06 20:30:13.768238 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.768184    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9471a230-7a31-495b-b2cb-a26be6b23ab9" containerName="main"
Jul 06 20:30:13.771208 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.771184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.775057 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.775023    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"default-dockercfg-t4mlj\""
Jul 06 20:30:13.775640 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.775619    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"kube-root-ca.crt\""
Jul 06 20:30:13.775762 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.775652    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"openshift-service-ca.crt\""
Jul 06 20:30:13.775762 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.775704    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"sub-test-model-a90d79-kserve-self-signed-certs\""
Jul 06 20:30:13.876911 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.876870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-dshm\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.877118 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.876913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-model-cache\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.877118 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.877050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fab291f-d056-4598-aad6-14f12d9ac772-tls-certs\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.877118 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.877087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-home\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.877303 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.877174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-tmp-dir\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.877303 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.877205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456b6\" (UniqueName: \"kubernetes.io/projected/3fab291f-d056-4598-aad6-14f12d9ac772-kube-api-access-456b6\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.922865 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.922829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"]
Jul 06 20:30:13.923712 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.923681    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:30:13.978014 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.977979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-tmp-dir\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978223 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-456b6\" (UniqueName: \"kubernetes.io/projected/3fab291f-d056-4598-aad6-14f12d9ac772-kube-api-access-456b6\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978223 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-dshm\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978223 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-model-cache\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978523 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fab291f-d056-4598-aad6-14f12d9ac772-tls-certs\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978600 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-home\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978600 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978563    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-tmp-dir\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.978713 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978626    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-model-cache\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.979005 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.978954    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-home\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.980560 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.980537    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-dshm\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:13.981065 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:13.981042    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fab291f-d056-4598-aad6-14f12d9ac772-tls-certs\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:14.009075 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:14.009043    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-456b6\" (UniqueName: \"kubernetes.io/projected/3fab291f-d056-4598-aad6-14f12d9ac772-kube-api-access-456b6\") pod \"sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") " pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:14.080997 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:14.080958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:14.264378 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:14.264323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"]
Jul 06 20:30:14.267477 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:30:14.267451    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fab291f_d056_4598_aad6_14f12d9ac772.slice/crio-db5df60be2e86ae141b717407fc50264830cb48a0ab3f30b3975be7134cdba2e WatchSource:0}: Error finding container db5df60be2e86ae141b717407fc50264830cb48a0ab3f30b3975be7134cdba2e: Status 404 returned error can't find the container with id db5df60be2e86ae141b717407fc50264830cb48a0ab3f30b3975be7134cdba2e
Jul 06 20:30:14.825830 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:14.825796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl" event={"ID":"3fab291f-d056-4598-aad6-14f12d9ac772","Type":"ContainerStarted","Data":"80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf"}
Jul 06 20:30:14.826245 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:14.825839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl" event={"ID":"3fab291f-d056-4598-aad6-14f12d9ac772","Type":"ContainerStarted","Data":"db5df60be2e86ae141b717407fc50264830cb48a0ab3f30b3975be7134cdba2e"}
Jul 06 20:30:14.853513 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:14.853462    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl" podStartSLOduration=1.8534453050000002 podStartE2EDuration="1.853445305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:14.853224109 +0000 UTC m=+2354.236882868" watchObservedRunningTime="2026-07-06 20:30:14.853445305 +0000 UTC m=+2354.237104053"
Jul 06 20:30:20.300466 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:20.300423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:30:24.081421 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:24.081347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:24.081896 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:24.081454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:24.095052 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:24.095021    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:24.895125 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:24.895096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:30:34.182815 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:34.182757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:30:53.586071 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:53.586018    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:30:59.259658 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:59.259623    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"]
Jul 06 20:30:59.335152 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:30:59.335081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:00.195508 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:00.195471    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"]
Jul 06 20:31:00.251679 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:00.251632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:01.195428 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:01.195401    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:31:01.199652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:01.199625    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:31:11.307824 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:11.307793    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:31:14.281001 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.280931    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn" podUID="e255f026-022f-449f-99b7-a0d3d6e16d51" containerName="main" containerID="cri-o://4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c" gracePeriod=45
Jul 06 20:31:14.552333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.552306    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:31:14.649659 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-model-cache\") pod \"e255f026-022f-449f-99b7-a0d3d6e16d51\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") "
Jul 06 20:31:14.649868 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649676    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e255f026-022f-449f-99b7-a0d3d6e16d51-tls-certs\") pod \"e255f026-022f-449f-99b7-a0d3d6e16d51\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") "
Jul 06 20:31:14.649868 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-home\") pod \"e255f026-022f-449f-99b7-a0d3d6e16d51\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") "
Jul 06 20:31:14.649868 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649767    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prc24\" (UniqueName: \"kubernetes.io/projected/e255f026-022f-449f-99b7-a0d3d6e16d51-kube-api-access-prc24\") pod \"e255f026-022f-449f-99b7-a0d3d6e16d51\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") "
Jul 06 20:31:14.649868 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-dshm\") pod \"e255f026-022f-449f-99b7-a0d3d6e16d51\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") "
Jul 06 20:31:14.650103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649874    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-tmp-dir\") pod \"e255f026-022f-449f-99b7-a0d3d6e16d51\" (UID: \"e255f026-022f-449f-99b7-a0d3d6e16d51\") "
Jul 06 20:31:14.650103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649963    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-model-cache" (OuterVolumeSpecName: "model-cache") pod "e255f026-022f-449f-99b7-a0d3d6e16d51" (UID: "e255f026-022f-449f-99b7-a0d3d6e16d51"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:14.650103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.649976    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-home" (OuterVolumeSpecName: "home") pod "e255f026-022f-449f-99b7-a0d3d6e16d51" (UID: "e255f026-022f-449f-99b7-a0d3d6e16d51"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:14.650272 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.650241    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:14.650272 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.650260    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:14.650272 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.650256    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e255f026-022f-449f-99b7-a0d3d6e16d51" (UID: "e255f026-022f-449f-99b7-a0d3d6e16d51"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:14.652054 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.652033    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e255f026-022f-449f-99b7-a0d3d6e16d51-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e255f026-022f-449f-99b7-a0d3d6e16d51" (UID: "e255f026-022f-449f-99b7-a0d3d6e16d51"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:31:14.652229 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.652208    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e255f026-022f-449f-99b7-a0d3d6e16d51-kube-api-access-prc24" (OuterVolumeSpecName: "kube-api-access-prc24") pod "e255f026-022f-449f-99b7-a0d3d6e16d51" (UID: "e255f026-022f-449f-99b7-a0d3d6e16d51"). InnerVolumeSpecName "kube-api-access-prc24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:31:14.652337 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.652318    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-dshm" (OuterVolumeSpecName: "dshm") pod "e255f026-022f-449f-99b7-a0d3d6e16d51" (UID: "e255f026-022f-449f-99b7-a0d3d6e16d51"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:14.751799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.751760    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e255f026-022f-449f-99b7-a0d3d6e16d51-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:14.751799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.751790    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prc24\" (UniqueName: \"kubernetes.io/projected/e255f026-022f-449f-99b7-a0d3d6e16d51-kube-api-access-prc24\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:14.751799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.751799    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:14.751799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:14.751808    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e255f026-022f-449f-99b7-a0d3d6e16d51-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:15.182304 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.182263    2581 generic.go:356] "Generic (PLEG): container finished" podID="e255f026-022f-449f-99b7-a0d3d6e16d51" containerID="4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c" exitCode=0
Jul 06 20:31:15.182304 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.182302    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"
Jul 06 20:31:15.182571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.182341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn" event={"ID":"e255f026-022f-449f-99b7-a0d3d6e16d51","Type":"ContainerDied","Data":"4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c"}
Jul 06 20:31:15.182571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.182400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn" event={"ID":"e255f026-022f-449f-99b7-a0d3d6e16d51","Type":"ContainerDied","Data":"99a77391541d0217acfcded9963214168cf701932c94a6f4f3985d9a97ca4896"}
Jul 06 20:31:15.182571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.182425    2581 scope.go:117] "RemoveContainer" containerID="4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c"
Jul 06 20:31:15.192448 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.192431    2581 scope.go:117] "RemoveContainer" containerID="4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c"
Jul 06 20:31:15.192742 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:31:15.192726    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c\": container with ID starting with 4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c not found: ID does not exist" containerID="4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c"
Jul 06 20:31:15.192838 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.192752    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c"} err="failed to get container status \"4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c\": rpc error: code = NotFound desc = could not find container \"4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c\": container with ID starting with 4f3fdb298d57964cb0069b4adf64a7cf905c8d11c090e37806d23972686e087c not found: ID does not exist"
Jul 06 20:31:15.216293 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.216252    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl" podUID="3fab291f-d056-4598-aad6-14f12d9ac772" containerName="main" containerID="cri-o://80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf" gracePeriod=45
Jul 06 20:31:15.218619 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.218592    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"]
Jul 06 20:31:15.223288 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.223267    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-629470/sub-test-model-629470-kserve-789b6fbf9-fcfzn"]
Jul 06 20:31:15.486047 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.486020    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:31:15.559193 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-tmp-dir\") pod \"3fab291f-d056-4598-aad6-14f12d9ac772\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") "
Jul 06 20:31:15.559350 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559200    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fab291f-d056-4598-aad6-14f12d9ac772-tls-certs\") pod \"3fab291f-d056-4598-aad6-14f12d9ac772\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") "
Jul 06 20:31:15.559350 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-model-cache\") pod \"3fab291f-d056-4598-aad6-14f12d9ac772\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") "
Jul 06 20:31:15.559350 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559287    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-456b6\" (UniqueName: \"kubernetes.io/projected/3fab291f-d056-4598-aad6-14f12d9ac772-kube-api-access-456b6\") pod \"3fab291f-d056-4598-aad6-14f12d9ac772\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") "
Jul 06 20:31:15.559531 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559444    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-dshm\") pod \"3fab291f-d056-4598-aad6-14f12d9ac772\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") "
Jul 06 20:31:15.559531 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559490    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-home\") pod \"3fab291f-d056-4598-aad6-14f12d9ac772\" (UID: \"3fab291f-d056-4598-aad6-14f12d9ac772\") "
Jul 06 20:31:15.559531 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559507    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fab291f-d056-4598-aad6-14f12d9ac772" (UID: "3fab291f-d056-4598-aad6-14f12d9ac772"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:15.559679 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559530    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fab291f-d056-4598-aad6-14f12d9ac772" (UID: "3fab291f-d056-4598-aad6-14f12d9ac772"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:15.559800 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559779    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-home" (OuterVolumeSpecName: "home") pod "3fab291f-d056-4598-aad6-14f12d9ac772" (UID: "3fab291f-d056-4598-aad6-14f12d9ac772"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:15.559876 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559857    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:15.559927 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.559884    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:15.561606 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.561577    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fab291f-d056-4598-aad6-14f12d9ac772-kube-api-access-456b6" (OuterVolumeSpecName: "kube-api-access-456b6") pod "3fab291f-d056-4598-aad6-14f12d9ac772" (UID: "3fab291f-d056-4598-aad6-14f12d9ac772"). InnerVolumeSpecName "kube-api-access-456b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:31:15.561708 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.561622    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-dshm" (OuterVolumeSpecName: "dshm") pod "3fab291f-d056-4598-aad6-14f12d9ac772" (UID: "3fab291f-d056-4598-aad6-14f12d9ac772"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:31:15.561708 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.561690    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fab291f-d056-4598-aad6-14f12d9ac772-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fab291f-d056-4598-aad6-14f12d9ac772" (UID: "3fab291f-d056-4598-aad6-14f12d9ac772"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:31:15.661355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.661314    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-456b6\" (UniqueName: \"kubernetes.io/projected/3fab291f-d056-4598-aad6-14f12d9ac772-kube-api-access-456b6\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:15.661355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.661349    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:15.661355 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.661396    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fab291f-d056-4598-aad6-14f12d9ac772-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:15.661640 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:15.661405    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fab291f-d056-4598-aad6-14f12d9ac772-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:31:16.189726 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.189687    2581 generic.go:356] "Generic (PLEG): container finished" podID="3fab291f-d056-4598-aad6-14f12d9ac772" containerID="80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf" exitCode=0
Jul 06 20:31:16.189908 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.189742    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"
Jul 06 20:31:16.189908 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.189776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl" event={"ID":"3fab291f-d056-4598-aad6-14f12d9ac772","Type":"ContainerDied","Data":"80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf"}
Jul 06 20:31:16.189908 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.189820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl" event={"ID":"3fab291f-d056-4598-aad6-14f12d9ac772","Type":"ContainerDied","Data":"db5df60be2e86ae141b717407fc50264830cb48a0ab3f30b3975be7134cdba2e"}
Jul 06 20:31:16.189908 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.189834    2581 scope.go:117] "RemoveContainer" containerID="80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf"
Jul 06 20:31:16.199161 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.199140    2581 scope.go:117] "RemoveContainer" containerID="80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf"
Jul 06 20:31:16.199480 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:31:16.199451    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf\": container with ID starting with 80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf not found: ID does not exist" containerID="80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf"
Jul 06 20:31:16.199551 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.199488    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf"} err="failed to get container status \"80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf\": rpc error: code = NotFound desc = could not find container \"80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf\": container with ID starting with 80b6c87afb1fe02aedb738682b2e3ada8f3720375886ff133b5ccb7effafd3bf not found: ID does not exist"
Jul 06 20:31:16.215357 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.215326    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"]
Jul 06 20:31:16.227843 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:16.227816    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/sub-test-model-a90d79-kserve-5fc5959cd7-n9hjl"]
Jul 06 20:31:17.024514 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.024481    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fab291f-d056-4598-aad6-14f12d9ac772" path="/var/lib/kubelet/pods/3fab291f-d056-4598-aad6-14f12d9ac772/volumes"
Jul 06 20:31:17.024902 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.024888    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e255f026-022f-449f-99b7-a0d3d6e16d51" path="/var/lib/kubelet/pods/e255f026-022f-449f-99b7-a0d3d6e16d51/volumes"
Jul 06 20:31:17.614838 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.614801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"]
Jul 06 20:31:17.615241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.615227    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fab291f-d056-4598-aad6-14f12d9ac772" containerName="main"
Jul 06 20:31:17.615286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.615244    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fab291f-d056-4598-aad6-14f12d9ac772" containerName="main"
Jul 06 20:31:17.615286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.615260    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e255f026-022f-449f-99b7-a0d3d6e16d51" containerName="main"
Jul 06 20:31:17.615286 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.615265    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e255f026-022f-449f-99b7-a0d3d6e16d51" containerName="main"
Jul 06 20:31:17.615411 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.615333    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e255f026-022f-449f-99b7-a0d3d6e16d51" containerName="main"
Jul 06 20:31:17.615411 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.615339    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fab291f-d056-4598-aad6-14f12d9ac772" containerName="main"
Jul 06 20:31:17.619393 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.619349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.625143 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.625099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"default-dockercfg-xjzj8\""
Jul 06 20:31:17.625308 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.625099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"openshift-service-ca.crt\""
Jul 06 20:31:17.626579 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.626560    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"kube-root-ca.crt\""
Jul 06 20:31:17.627127 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.627110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-629470\"/\"rate-test-model-629470-kserve-self-signed-certs\""
Jul 06 20:31:17.670785 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.670749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"]
Jul 06 20:31:17.782587 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.782542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx66q\" (UniqueName: \"kubernetes.io/projected/35e06e3c-35aa-4398-ad14-e90505ebd8b2-kube-api-access-bx66q\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.782587 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.782589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-dshm\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.782852 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.782611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tmp-dir\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.782852 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.782734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tls-certs\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.782852 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.782793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-home\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.782852 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.782842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-model-cache\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.866615 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.866515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:17.883676 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.883636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-home\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.883880 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.883710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-model-cache\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.883880 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.883746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx66q\" (UniqueName: \"kubernetes.io/projected/35e06e3c-35aa-4398-ad14-e90505ebd8b2-kube-api-access-bx66q\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.883880 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.883770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-dshm\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.883880 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.883792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tmp-dir\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.884115 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.883896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tls-certs\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.884165 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.884125    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-home\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.884665 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.884641    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-model-cache\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.885119 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.885094    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tmp-dir\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.887064 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.887040    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tls-certs\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.887175 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.887092    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-dshm\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.900083 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.900051    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx66q\" (UniqueName: \"kubernetes.io/projected/35e06e3c-35aa-4398-ad14-e90505ebd8b2-kube-api-access-bx66q\") pod \"rate-test-model-629470-kserve-84477d664c-qndpb\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") " pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:17.929074 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:17.929035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:18.104295 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:18.104268    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"]
Jul 06 20:31:18.106818 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:31:18.106783    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35e06e3c_35aa_4398_ad14_e90505ebd8b2.slice/crio-99b799b734dff8d17d52b4e92a11e6f2dc697f31c5ab85c9483ad7d443108e22 WatchSource:0}: Error finding container 99b799b734dff8d17d52b4e92a11e6f2dc697f31c5ab85c9483ad7d443108e22: Status 404 returned error can't find the container with id 99b799b734dff8d17d52b4e92a11e6f2dc697f31c5ab85c9483ad7d443108e22
Jul 06 20:31:18.203189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:18.203145    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb" event={"ID":"35e06e3c-35aa-4398-ad14-e90505ebd8b2","Type":"ContainerStarted","Data":"a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df"}
Jul 06 20:31:18.203358 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:18.203204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb" event={"ID":"35e06e3c-35aa-4398-ad14-e90505ebd8b2","Type":"ContainerStarted","Data":"99b799b734dff8d17d52b4e92a11e6f2dc697f31c5ab85c9483ad7d443108e22"}
Jul 06 20:31:18.265765 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:18.265712    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb" podStartSLOduration=1.265693927 podStartE2EDuration="1.265693927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:18.263126303 +0000 UTC m=+2417.646785052" watchObservedRunningTime="2026-07-06 20:31:18.265693927 +0000 UTC m=+2417.649352675"
Jul 06 20:31:21.611767 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:21.611671    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:31:27.929633 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:27.929599    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:27.930082 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:27.929852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:27.942416 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:27.942392    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:28.270059 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:28.269970    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:31:43.620416 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:43.620355    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:43.735396 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:43.735337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:52.448766 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:52.448732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:52.573942 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:52.573905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:57.465562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.465487    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"]
Jul 06 20:31:57.468288 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.468260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:57.469165 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.469151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.473289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.473266    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"rate-test-model-a90d79-kserve-self-signed-certs\""
Jul 06 20:31:57.473444 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.473302    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"kube-root-ca.crt\""
Jul 06 20:31:57.473444 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.473328    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"default-dockercfg-t4mlj\""
Jul 06 20:31:57.473444 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.473266    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a90d79\"/\"openshift-service-ca.crt\""
Jul 06 20:31:57.504376 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.504339    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"]
Jul 06 20:31:57.547156 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.547121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-home\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.547156 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.547163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-tmp-dir\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.547402 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.547197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782abe2c-2583-4382-9e86-5ab2bb527cf3-tls-certs\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.547402 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.547227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-model-cache\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.547402 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.547259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-dshm\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.547402 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.547277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc6rl\" (UniqueName: \"kubernetes.io/projected/782abe2c-2583-4382-9e86-5ab2bb527cf3-kube-api-access-gc6rl\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.648234 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.648199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-home\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.648532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.648508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-tmp-dir\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.648708 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.648691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782abe2c-2583-4382-9e86-5ab2bb527cf3-tls-certs\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.648897 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.648878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-model-cache\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.649051 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.649014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-dshm\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.649051 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.649049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc6rl\" (UniqueName: \"kubernetes.io/projected/782abe2c-2583-4382-9e86-5ab2bb527cf3-kube-api-access-gc6rl\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.649249 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.649217    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-model-cache\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.649333 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.648941    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-tmp-dir\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.649458 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.648798    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-home\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.651637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.651600    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-dshm\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.651745 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.651658    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782abe2c-2583-4382-9e86-5ab2bb527cf3-tls-certs\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.661826 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.661660    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc6rl\" (UniqueName: \"kubernetes.io/projected/782abe2c-2583-4382-9e86-5ab2bb527cf3-kube-api-access-gc6rl\") pod \"rate-test-model-a90d79-kserve-564bc4499-q7d77\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") " pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.780232 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.780134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:31:57.942679 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:57.942647    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"]
Jul 06 20:31:57.944240 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:31:57.944200    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod782abe2c_2583_4382_9e86_5ab2bb527cf3.slice/crio-406ea77fdd8d638ea7bb6619654bbb2ebdeed4b5a0e8841252f14942da7b4499 WatchSource:0}: Error finding container 406ea77fdd8d638ea7bb6619654bbb2ebdeed4b5a0e8841252f14942da7b4499: Status 404 returned error can't find the container with id 406ea77fdd8d638ea7bb6619654bbb2ebdeed4b5a0e8841252f14942da7b4499
Jul 06 20:31:58.435412 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:58.435346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77" event={"ID":"782abe2c-2583-4382-9e86-5ab2bb527cf3","Type":"ContainerStarted","Data":"33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3"}
Jul 06 20:31:58.435614 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:58.435424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77" event={"ID":"782abe2c-2583-4382-9e86-5ab2bb527cf3","Type":"ContainerStarted","Data":"406ea77fdd8d638ea7bb6619654bbb2ebdeed4b5a0e8841252f14942da7b4499"}
Jul 06 20:31:58.468926 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:31:58.468870    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77" podStartSLOduration=1.468853776 podStartE2EDuration="1.468853776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:58.467289193 +0000 UTC m=+2457.850947942" watchObservedRunningTime="2026-07-06 20:31:58.468853776 +0000 UTC m=+2457.852512524"
Jul 06 20:32:02.662370 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:02.662336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:32:07.780704 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:07.780669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:32:07.781187 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:07.780720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:32:07.796799 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:07.796775    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:32:08.499290 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:08.499249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:32:22.367735 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:22.367700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:32:36.042399 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:36.042345    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:32:42.747106 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:42.747064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"]
Jul 06 20:32:42.766868 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:42.766839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:43.809219 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:43.809182    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"]
Jul 06 20:32:43.837820 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:43.837786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:44.987895 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:44.987852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:45.386601 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:45.386564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:45.488860 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:45.488827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:45.591403 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:45.591322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:45.746743 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:45.746658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:49.347834 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:49.347796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:32:50.460207 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:50.460169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:57.767911 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:57.767860    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb" podUID="35e06e3c-35aa-4398-ad14-e90505ebd8b2" containerName="main" containerID="cri-o://a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df" gracePeriod=45
Jul 06 20:32:58.038204 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.038175    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:32:58.146532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tmp-dir\") pod \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") "
Jul 06 20:32:58.146532 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-dshm\") pod \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") "
Jul 06 20:32:58.146770 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146572    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx66q\" (UniqueName: \"kubernetes.io/projected/35e06e3c-35aa-4398-ad14-e90505ebd8b2-kube-api-access-bx66q\") pod \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") "
Jul 06 20:32:58.146770 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tls-certs\") pod \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") "
Jul 06 20:32:58.146770 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-home\") pod \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") "
Jul 06 20:32:58.146937 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146779    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "35e06e3c-35aa-4398-ad14-e90505ebd8b2" (UID: "35e06e3c-35aa-4398-ad14-e90505ebd8b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:58.146937 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-model-cache\") pod \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\" (UID: \"35e06e3c-35aa-4398-ad14-e90505ebd8b2\") "
Jul 06 20:32:58.146937 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.146871    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-home" (OuterVolumeSpecName: "home") pod "35e06e3c-35aa-4398-ad14-e90505ebd8b2" (UID: "35e06e3c-35aa-4398-ad14-e90505ebd8b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:58.147099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.147007    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "35e06e3c-35aa-4398-ad14-e90505ebd8b2" (UID: "35e06e3c-35aa-4398-ad14-e90505ebd8b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:58.147162 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.147147    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:58.147223 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.147167    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:58.147223 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.147179    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:58.148863 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.148838    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-dshm" (OuterVolumeSpecName: "dshm") pod "35e06e3c-35aa-4398-ad14-e90505ebd8b2" (UID: "35e06e3c-35aa-4398-ad14-e90505ebd8b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:58.148965 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.148880    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e06e3c-35aa-4398-ad14-e90505ebd8b2-kube-api-access-bx66q" (OuterVolumeSpecName: "kube-api-access-bx66q") pod "35e06e3c-35aa-4398-ad14-e90505ebd8b2" (UID: "35e06e3c-35aa-4398-ad14-e90505ebd8b2"). InnerVolumeSpecName "kube-api-access-bx66q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:58.148965 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.148880    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "35e06e3c-35aa-4398-ad14-e90505ebd8b2" (UID: "35e06e3c-35aa-4398-ad14-e90505ebd8b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:32:58.247841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.247798    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35e06e3c-35aa-4398-ad14-e90505ebd8b2-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:58.247841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.247835    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx66q\" (UniqueName: \"kubernetes.io/projected/35e06e3c-35aa-4398-ad14-e90505ebd8b2-kube-api-access-bx66q\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:58.247841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.247846    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35e06e3c-35aa-4398-ad14-e90505ebd8b2-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:58.766537 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.766504    2581 generic.go:356] "Generic (PLEG): container finished" podID="35e06e3c-35aa-4398-ad14-e90505ebd8b2" containerID="a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df" exitCode=0
Jul 06 20:32:58.766537 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.766544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb" event={"ID":"35e06e3c-35aa-4398-ad14-e90505ebd8b2","Type":"ContainerDied","Data":"a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df"}
Jul 06 20:32:58.766537 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.766546    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"
Jul 06 20:32:58.766818 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.766570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb" event={"ID":"35e06e3c-35aa-4398-ad14-e90505ebd8b2","Type":"ContainerDied","Data":"99b799b734dff8d17d52b4e92a11e6f2dc697f31c5ab85c9483ad7d443108e22"}
Jul 06 20:32:58.766818 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.766585    2581 scope.go:117] "RemoveContainer" containerID="a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df"
Jul 06 20:32:58.779136 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.779114    2581 scope.go:117] "RemoveContainer" containerID="a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df"
Jul 06 20:32:58.779986 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:32:58.779960    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df\": container with ID starting with a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df not found: ID does not exist" containerID="a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df"
Jul 06 20:32:58.780080 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.779997    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df"} err="failed to get container status \"a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df\": rpc error: code = NotFound desc = could not find container \"a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df\": container with ID starting with a57d7cef9d6922f5cd5d275d7c9fbc07b2a0e46aa2f36ba503b0f8299dcab5df not found: ID does not exist"
Jul 06 20:32:58.793788 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.793728    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"]
Jul 06 20:32:58.796020 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.795994    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-629470/rate-test-model-629470-kserve-84477d664c-qndpb"]
Jul 06 20:32:58.829956 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:58.829910    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77" podUID="782abe2c-2583-4382-9e86-5ab2bb527cf3" containerName="main" containerID="cri-o://33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3" gracePeriod=45
Jul 06 20:32:59.026964 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.026886    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e06e3c-35aa-4398-ad14-e90505ebd8b2" path="/var/lib/kubelet/pods/35e06e3c-35aa-4398-ad14-e90505ebd8b2/volumes"
Jul 06 20:32:59.094652 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.094622    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:32:59.155256 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc6rl\" (UniqueName: \"kubernetes.io/projected/782abe2c-2583-4382-9e86-5ab2bb527cf3-kube-api-access-gc6rl\") pod \"782abe2c-2583-4382-9e86-5ab2bb527cf3\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") "
Jul 06 20:32:59.155497 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155321    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782abe2c-2583-4382-9e86-5ab2bb527cf3-tls-certs\") pod \"782abe2c-2583-4382-9e86-5ab2bb527cf3\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") "
Jul 06 20:32:59.155497 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-tmp-dir\") pod \"782abe2c-2583-4382-9e86-5ab2bb527cf3\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") "
Jul 06 20:32:59.155497 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155425    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-dshm\") pod \"782abe2c-2583-4382-9e86-5ab2bb527cf3\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") "
Jul 06 20:32:59.155497 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155466    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-home\") pod \"782abe2c-2583-4382-9e86-5ab2bb527cf3\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") "
Jul 06 20:32:59.155497 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155495    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-model-cache\") pod \"782abe2c-2583-4382-9e86-5ab2bb527cf3\" (UID: \"782abe2c-2583-4382-9e86-5ab2bb527cf3\") "
Jul 06 20:32:59.155782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155744    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "782abe2c-2583-4382-9e86-5ab2bb527cf3" (UID: "782abe2c-2583-4382-9e86-5ab2bb527cf3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:59.155782 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155763    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-home" (OuterVolumeSpecName: "home") pod "782abe2c-2583-4382-9e86-5ab2bb527cf3" (UID: "782abe2c-2583-4382-9e86-5ab2bb527cf3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:59.155872 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.155782    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-model-cache" (OuterVolumeSpecName: "model-cache") pod "782abe2c-2583-4382-9e86-5ab2bb527cf3" (UID: "782abe2c-2583-4382-9e86-5ab2bb527cf3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:59.157650 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.157621    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782abe2c-2583-4382-9e86-5ab2bb527cf3-kube-api-access-gc6rl" (OuterVolumeSpecName: "kube-api-access-gc6rl") pod "782abe2c-2583-4382-9e86-5ab2bb527cf3" (UID: "782abe2c-2583-4382-9e86-5ab2bb527cf3"). InnerVolumeSpecName "kube-api-access-gc6rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:59.157650 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.157638    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-dshm" (OuterVolumeSpecName: "dshm") pod "782abe2c-2583-4382-9e86-5ab2bb527cf3" (UID: "782abe2c-2583-4382-9e86-5ab2bb527cf3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:59.157790 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.157706    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/782abe2c-2583-4382-9e86-5ab2bb527cf3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "782abe2c-2583-4382-9e86-5ab2bb527cf3" (UID: "782abe2c-2583-4382-9e86-5ab2bb527cf3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:32:59.256637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.256593    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc6rl\" (UniqueName: \"kubernetes.io/projected/782abe2c-2583-4382-9e86-5ab2bb527cf3-kube-api-access-gc6rl\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:59.256637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.256630    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782abe2c-2583-4382-9e86-5ab2bb527cf3-tls-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:59.256637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.256640    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-tmp-dir\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:59.256637 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.256648    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-dshm\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:59.256913 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.256657    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-home\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:59.256913 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.256666    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782abe2c-2583-4382-9e86-5ab2bb527cf3-model-cache\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:32:59.773421 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.773386    2581 generic.go:356] "Generic (PLEG): container finished" podID="782abe2c-2583-4382-9e86-5ab2bb527cf3" containerID="33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3" exitCode=0
Jul 06 20:32:59.773605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.773472    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"
Jul 06 20:32:59.773605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.773486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77" event={"ID":"782abe2c-2583-4382-9e86-5ab2bb527cf3","Type":"ContainerDied","Data":"33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3"}
Jul 06 20:32:59.773605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.773539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77" event={"ID":"782abe2c-2583-4382-9e86-5ab2bb527cf3","Type":"ContainerDied","Data":"406ea77fdd8d638ea7bb6619654bbb2ebdeed4b5a0e8841252f14942da7b4499"}
Jul 06 20:32:59.773605 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.773596    2581 scope.go:117] "RemoveContainer" containerID="33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3"
Jul 06 20:32:59.785314 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.785141    2581 scope.go:117] "RemoveContainer" containerID="33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3"
Jul 06 20:32:59.785641 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:32:59.785473    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3\": container with ID starting with 33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3 not found: ID does not exist" containerID="33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3"
Jul 06 20:32:59.785641 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.785510    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3"} err="failed to get container status \"33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3\": rpc error: code = NotFound desc = could not find container \"33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3\": container with ID starting with 33a8710c0fbd3416d9029bc9d85384f09e01ea55197841f58601b01adacacdc3 not found: ID does not exist"
Jul 06 20:32:59.800075 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.800041    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"]
Jul 06 20:32:59.802216 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:32:59.802196    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a90d79/rate-test-model-a90d79-kserve-564bc4499-q7d77"]
Jul 06 20:32:59.818473 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:32:59.818428    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod782abe2c_2583_4382_9e86_5ab2bb527cf3.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod782abe2c_2583_4382_9e86_5ab2bb527cf3.slice/crio-406ea77fdd8d638ea7bb6619654bbb2ebdeed4b5a0e8841252f14942da7b4499\": RecentStats: unable to find data in memory cache]"
Jul 06 20:33:01.024231 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:01.024196    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="782abe2c-2583-4382-9e86-5ab2bb527cf3" path="/var/lib/kubelet/pods/782abe2c-2583-4382-9e86-5ab2bb527cf3/volumes"
Jul 06 20:33:14.369390 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:14.369330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:14.751960 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:14.751856    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"]
Jul 06 20:33:14.752168 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:14.752118    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy" containerID="cri-o://9b7b33d8fc11492fc9f40d9f3fad7347451d9e669c202fcef6be5a5e2dd033dc" gracePeriod=30
Jul 06 20:33:14.765553 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:14.765513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:14.995795 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:14.995757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:15.177974 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:15.177924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:15.615241 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:15.615208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:15.795307 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:15.795269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:15.892964 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:15.892868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:16.134898 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:16.134866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:18.849554 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:18.849517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j5wb5"]
Jul 06 20:33:19.894002 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:19.893966    2581 generic.go:356] "Generic (PLEG): container finished" podID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerID="9b7b33d8fc11492fc9f40d9f3fad7347451d9e669c202fcef6be5a5e2dd033dc" exitCode=0
Jul 06 20:33:19.894430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:19.894035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" event={"ID":"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee","Type":"ContainerDied","Data":"9b7b33d8fc11492fc9f40d9f3fad7347451d9e669c202fcef6be5a5e2dd033dc"}
Jul 06 20:33:19.894430 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:19.894097    2581 scope.go:117] "RemoveContainer" containerID="56da9c7e8f144da8e97e4bf7c830190be999eaf55bfe93f0a828eb7300a1a99e"
Jul 06 20:33:20.018769 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.018692    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:33:20.156387 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156325    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-credential-socket\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-envoy\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-certs\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156521    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-data\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156550    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk5j4\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-kube-api-access-pk5j4\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156812 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-token\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156812 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156641    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istiod-ca-cert\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156812 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-podinfo\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.156812 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156692    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:20.157010 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-socket\") pod \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\" (UID: \"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee\") "
Jul 06 20:33:20.157010 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156847    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:20.157010 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.156931    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:20.157216 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.157153    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:33:20.157299 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.157244    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.157387 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.157273    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.157869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.157423    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.157869 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.157701    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:20.159023 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.158997    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:33:20.159023 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.159007    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-kube-api-access-pk5j4" (OuterVolumeSpecName: "kube-api-access-pk5j4") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "kube-api-access-pk5j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:33:20.159167 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.159067    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:20.159220 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.159196    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" (UID: "d3a43f24-4e8a-4bdd-8229-e4220de4b6ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:33:20.258841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.258790    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.258841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.258840    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk5j4\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-kube-api-access-pk5j4\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.258841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.258851    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.258841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.258859    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.258841 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.258867    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.259169 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.258874    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:20.901614 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.901578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h" event={"ID":"d3a43f24-4e8a-4bdd-8229-e4220de4b6ee","Type":"ContainerDied","Data":"4a8de8b81eedbf61c88c0d69d1c97bb325dbcf8e0fff1287c71b7ecdca21003a"}
Jul 06 20:33:20.901614 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.901595    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"
Jul 06 20:33:20.902127 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.901635    2581 scope.go:117] "RemoveContainer" containerID="9b7b33d8fc11492fc9f40d9f3fad7347451d9e669c202fcef6be5a5e2dd033dc"
Jul 06 20:33:20.926753 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.926714    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"]
Jul 06 20:33:20.932641 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:20.932610    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-629470-openshift-default-5bd46b77c5-rc67h"]
Jul 06 20:33:21.023945 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:21.023912    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" path="/var/lib/kubelet/pods/d3a43f24-4e8a-4bdd-8229-e4220de4b6ee/volumes"
Jul 06 20:33:22.082547 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:22.082512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:22.182081 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:22.182047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:22.346485 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:22.346400    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"]
Jul 06 20:33:22.346646 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:22.346598    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy" containerID="cri-o://4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd" gracePeriod=30
Jul 06 20:33:22.374275 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:22.374207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:22.595688 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:22.595648    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:27.619769 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.619700    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:33:27.630154 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-certs\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-token\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-credential-socket\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-envoy\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-socket\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-podinfo\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630564 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630292    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k5x9\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-kube-api-access-4k5x9\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630564 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630342    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istiod-ca-cert\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630564 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630471    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-data\") pod \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\" (UID: \"df223bf4-f76d-4c7a-a456-f7d6cb497e26\") "
Jul 06 20:33:27.630564 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630522    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:27.630764 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630672    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:27.630764 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630686    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:27.630833 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630820    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.630921 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630838    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-workload-certs\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.630921 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.630852    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-credential-socket\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.631110 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.631088    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:33:27.631864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.631833    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-data" (OuterVolumeSpecName: "istio-data") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:27.632576 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.632554    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-token" (OuterVolumeSpecName: "istio-token") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:33:27.632796 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.632777    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:27.633184 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.633157    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:33:27.633184 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.633166    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-kube-api-access-4k5x9" (OuterVolumeSpecName: "kube-api-access-4k5x9") pod "df223bf4-f76d-4c7a-a456-f7d6cb497e26" (UID: "df223bf4-f76d-4c7a-a456-f7d6cb497e26"). InnerVolumeSpecName "kube-api-access-4k5x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:33:27.731306 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.731263    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-token\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.731306 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.731298    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-envoy\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.731306 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.731311    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-podinfo\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.731590 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.731323    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k5x9\" (UniqueName: \"kubernetes.io/projected/df223bf4-f76d-4c7a-a456-f7d6cb497e26-kube-api-access-4k5x9\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.731590 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.731336    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istiod-ca-cert\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.731590 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.731346    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df223bf4-f76d-4c7a-a456-f7d6cb497e26-istio-data\") on node \"ip-10-0-142-134.ec2.internal\" DevicePath \"\""
Jul 06 20:33:27.905845 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.905754    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-679cc_156198ce-4a5d-425e-8a60-7e04d566a21e/manager/1.log"
Jul 06 20:33:27.941927 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.941892    2581 generic.go:356] "Generic (PLEG): container finished" podID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerID="4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd" exitCode=0
Jul 06 20:33:27.942099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.941949    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"
Jul 06 20:33:27.942099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.941956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" event={"ID":"df223bf4-f76d-4c7a-a456-f7d6cb497e26","Type":"ContainerDied","Data":"4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd"}
Jul 06 20:33:27.942099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.942013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8" event={"ID":"df223bf4-f76d-4c7a-a456-f7d6cb497e26","Type":"ContainerDied","Data":"43eaa20ddba2f833ef5f3d0731aed70305861948ee02ec4b8c2400602dccfeb6"}
Jul 06 20:33:27.942099 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.942043    2581 scope.go:117] "RemoveContainer" containerID="4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd"
Jul 06 20:33:27.951798 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.951778    2581 scope.go:117] "RemoveContainer" containerID="e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"
Jul 06 20:33:27.961117 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.961096    2581 scope.go:117] "RemoveContainer" containerID="4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd"
Jul 06 20:33:27.961449 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:33:27.961425    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd\": container with ID starting with 4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd not found: ID does not exist" containerID="4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd"
Jul 06 20:33:27.961525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.961458    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd"} err="failed to get container status \"4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd\": rpc error: code = NotFound desc = could not find container \"4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd\": container with ID starting with 4f94ddb83a20ebfe437fbb8d1c9007fcd99ac6efcf01e83d544f02c62ffa54dd not found: ID does not exist"
Jul 06 20:33:27.961525 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.961477    2581 scope.go:117] "RemoveContainer" containerID="e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"
Jul 06 20:33:27.961728 ip-10-0-142-134 kubenswrapper[2581]: E0706 20:33:27.961711    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15\": container with ID starting with e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15 not found: ID does not exist" containerID="e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"
Jul 06 20:33:27.961772 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.961734    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15"} err="failed to get container status \"e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15\": rpc error: code = NotFound desc = could not find container \"e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15\": container with ID starting with e705b33dcd49dcf81673cc35972252620023d83160e0441c759af51283260f15 not found: ID does not exist"
Jul 06 20:33:27.965435 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.965410    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"]
Jul 06 20:33:27.970320 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:27.970293    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a90d79-openshift-default-75d76b47-cp2s8"]
Jul 06 20:33:28.031697 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:28.031663    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tvrs2_5644e8a4-0902-4360-b2a9-80d8ec61c0c5/manager/1.log"
Jul 06 20:33:29.023640 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:29.023608    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" path="/var/lib/kubelet/pods/df223bf4-f76d-4c7a-a456-f7d6cb497e26/volumes"
Jul 06 20:33:29.201917 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:29.201884    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549b57869c-ltkkm_93437268-e618-4314-91bb-fbb67fd27994/copy-manifests/0.log"
Jul 06 20:33:29.221306 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:29.221277    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549b57869c-ltkkm_93437268-e618-4314-91bb-fbb67fd27994/manager/0.log"
Jul 06 20:33:30.821105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:30.821076    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g5vkl_7d5e6e05-6fbd-4411-960b-98727841f5a0/manager/1.log"
Jul 06 20:33:30.940946 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:30.940921    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf6wj_c331061b-5c62-42c8-bc60-3a80df948771/manager/1.log"
Jul 06 20:33:31.178579 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:31.178490    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pc6nl_8d370138-210f-463f-ac34-14c238079430/registry-server/0.log"
Jul 06 20:33:31.314090 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:31.314053    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pdw9w_c0477dd0-101b-49e3-ba85-9dcd96aac44b/manager/1.log"
Jul 06 20:33:31.432552 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:31.432464    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j5wb5_fb2eff6a-f1ba-4c1f-b658-e89ca05d48be/limitador/0.log"
Jul 06 20:33:31.553588 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:31.553560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-st6gw_b8896722-ae74-457e-a266-f68cf5618bba/manager/1.log"
Jul 06 20:33:31.894562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:31.894525    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxw5q_6e59f972-4a34-4543-8818-9d4a0b9f389c/istio-proxy/0.log"
Jul 06 20:33:32.121688 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:32.121653    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf55b576c-94ghc_3f5553ba-7139-42ee-916f-10f85f747ca8/kube-auth-proxy/0.log"
Jul 06 20:33:32.349268 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:32.349238    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/1.log"
Jul 06 20:33:32.702577 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:32.702492    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d5fdddbfc-xwvqf_14d488ca-2078-490c-bab3-34e4044b0c7a/router/0.log"
Jul 06 20:33:37.390654 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.390615    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jzwh/must-gather-gsnhv"]
Jul 06 20:33:37.391060 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391046    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy"
Jul 06 20:33:37.391105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391062    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy"
Jul 06 20:33:37.391105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391072    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy"
Jul 06 20:33:37.391105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391079    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy"
Jul 06 20:33:37.391105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391093    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy"
Jul 06 20:33:37.391105 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391112    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e06e3c-35aa-4398-ad14-e90505ebd8b2" containerName="main"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391117    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e06e3c-35aa-4398-ad14-e90505ebd8b2" containerName="main"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391125    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782abe2c-2583-4382-9e86-5ab2bb527cf3" containerName="main"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391130    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="782abe2c-2583-4382-9e86-5ab2bb527cf3" containerName="main"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391207    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391215    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391221    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391227    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="782abe2c-2583-4382-9e86-5ab2bb527cf3" containerName="main"
Jul 06 20:33:37.391274 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391237    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e06e3c-35aa-4398-ad14-e90505ebd8b2" containerName="main"
Jul 06 20:33:37.391578 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391294    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy"
Jul 06 20:33:37.391578 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391300    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a43f24-4e8a-4bdd-8229-e4220de4b6ee" containerName="istio-proxy"
Jul 06 20:33:37.391578 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.391408    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df223bf4-f76d-4c7a-a456-f7d6cb497e26" containerName="istio-proxy"
Jul 06 20:33:37.394537 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.394517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.400096 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.400069    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5jzwh\"/\"default-dockercfg-k87kc\""
Jul 06 20:33:37.400262 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.400071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jzwh\"/\"kube-root-ca.crt\""
Jul 06 20:33:37.400262 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.400207    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jzwh\"/\"openshift-service-ca.crt\""
Jul 06 20:33:37.409122 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.409095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jzwh/must-gather-gsnhv"]
Jul 06 20:33:37.414884 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.414848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcc9fa90-bb88-4bf8-be77-f6373633d952-must-gather-output\") pod \"must-gather-gsnhv\" (UID: \"dcc9fa90-bb88-4bf8-be77-f6373633d952\") " pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.415043 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.414961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snhf\" (UniqueName: \"kubernetes.io/projected/dcc9fa90-bb88-4bf8-be77-f6373633d952-kube-api-access-8snhf\") pod \"must-gather-gsnhv\" (UID: \"dcc9fa90-bb88-4bf8-be77-f6373633d952\") " pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.426043 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.426002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:37.516455 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.516417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcc9fa90-bb88-4bf8-be77-f6373633d952-must-gather-output\") pod \"must-gather-gsnhv\" (UID: \"dcc9fa90-bb88-4bf8-be77-f6373633d952\") " pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.516671 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.516475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snhf\" (UniqueName: \"kubernetes.io/projected/dcc9fa90-bb88-4bf8-be77-f6373633d952-kube-api-access-8snhf\") pod \"must-gather-gsnhv\" (UID: \"dcc9fa90-bb88-4bf8-be77-f6373633d952\") " pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.516864 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.516836    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcc9fa90-bb88-4bf8-be77-f6373633d952-must-gather-output\") pod \"must-gather-gsnhv\" (UID: \"dcc9fa90-bb88-4bf8-be77-f6373633d952\") " pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.525023 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.524989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snhf\" (UniqueName: \"kubernetes.io/projected/dcc9fa90-bb88-4bf8-be77-f6373633d952-kube-api-access-8snhf\") pod \"must-gather-gsnhv\" (UID: \"dcc9fa90-bb88-4bf8-be77-f6373633d952\") " pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.563780 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.563739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:37.704131 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.704031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jzwh/must-gather-gsnhv"
Jul 06 20:33:37.859953 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.859914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jzwh/must-gather-gsnhv"]
Jul 06 20:33:37.863112 ip-10-0-142-134 kubenswrapper[2581]: W0706 20:33:37.863078    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcc9fa90_bb88_4bf8_be77_f6373633d952.slice/crio-de3759befb3edf6cbb9a1c3e0240545074c5af3b535bf6f236f81660661e275d WatchSource:0}: Error finding container de3759befb3edf6cbb9a1c3e0240545074c5af3b535bf6f236f81660661e275d: Status 404 returned error can't find the container with id de3759befb3edf6cbb9a1c3e0240545074c5af3b535bf6f236f81660661e275d
Jul 06 20:33:37.865192 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.865171    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:33:37.996696 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:37.996600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jzwh/must-gather-gsnhv" event={"ID":"dcc9fa90-bb88-4bf8-be77-f6373633d952","Type":"ContainerStarted","Data":"de3759befb3edf6cbb9a1c3e0240545074c5af3b535bf6f236f81660661e275d"}
Jul 06 20:33:39.008332 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:39.008230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jzwh/must-gather-gsnhv" event={"ID":"dcc9fa90-bb88-4bf8-be77-f6373633d952","Type":"ContainerStarted","Data":"3479aed9b40b13f2a2eec3620c6bab548580798e34df48f74af068a916d4ad45"}
Jul 06 20:33:39.008332 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:39.008279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jzwh/must-gather-gsnhv" event={"ID":"dcc9fa90-bb88-4bf8-be77-f6373633d952","Type":"ContainerStarted","Data":"0fa4b43e8df0bbfccd9ac924ab369a9e97f474ac4a893eeb432215c309059c61"}
Jul 06 20:33:39.033050 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:39.032998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5jzwh/must-gather-gsnhv" podStartSLOduration=1.193975874 podStartE2EDuration="2.032979935s" totalImagesPullingTime="839.004061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:33:39.031475436 +0000 UTC m=+2558.415134186" watchObservedRunningTime="2026-07-06 20:33:39.032979935 +0000 UTC m=+2558.416638720"
Jul 06 20:33:40.626920 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:40.626876    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b8z2d_1f89b8fe-d2e4-4df0-b8d4-d543f0d49ab3/global-pull-secret-syncer/0.log"
Jul 06 20:33:40.783103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:40.783064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log"
Jul 06 20:33:40.964109 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:40.964006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-134.ec2.internal_d64b863190df7f2a681aceffe233fdc3/haproxy/0.log"
Jul 06 20:33:41.550322 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:41.550282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72x5s_e4efc3c4-f7c4-4699-96f3-8d4f24e04f24/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:46.274760 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.274723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g5vkl_7d5e6e05-6fbd-4411-960b-98727841f5a0/manager/1.log"
Jul 06 20:33:46.278280 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.278205    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g5vkl_7d5e6e05-6fbd-4411-960b-98727841f5a0/manager/0.log"
Jul 06 20:33:46.334996 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.334941    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf6wj_c331061b-5c62-42c8-bc60-3a80df948771/manager/0.log"
Jul 06 20:33:46.336313 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.336284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf6wj_c331061b-5c62-42c8-bc60-3a80df948771/manager/1.log"
Jul 06 20:33:46.468411 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.468354    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pc6nl_8d370138-210f-463f-ac34-14c238079430/registry-server/0.log"
Jul 06 20:33:46.603222 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.603181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pdw9w_c0477dd0-101b-49e3-ba85-9dcd96aac44b/manager/0.log"
Jul 06 20:33:46.709193 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:46.709152    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pdw9w_c0477dd0-101b-49e3-ba85-9dcd96aac44b/manager/1.log"
Jul 06 20:33:47.144434 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:47.144385    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j5wb5_fb2eff6a-f1ba-4c1f-b658-e89ca05d48be/limitador/0.log"
Jul 06 20:33:47.213566 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:47.213526    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-st6gw_b8896722-ae74-457e-a266-f68cf5618bba/manager/0.log"
Jul 06 20:33:47.254804 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:47.254765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-st6gw_b8896722-ae74-457e-a266-f68cf5618bba/manager/1.log"
Jul 06 20:33:49.126598 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.126566    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-zgbgn_118802f9-1420-4ad4-bc20-76d17dcb7871/cluster-monitoring-operator/0.log"
Jul 06 20:33:49.269923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.269881    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-cldkq_5b747520-23f2-436e-9f0e-a6bec9f5b1fc/monitoring-plugin/0.log"
Jul 06 20:33:49.316897 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.316871    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g5thn_fc5c436e-9806-45b2-bdfe-55077ea09a00/node-exporter/0.log"
Jul 06 20:33:49.347222 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.347193    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g5thn_fc5c436e-9806-45b2-bdfe-55077ea09a00/kube-rbac-proxy/0.log"
Jul 06 20:33:49.382626 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.382519    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g5thn_fc5c436e-9806-45b2-bdfe-55077ea09a00/init-textfile/0.log"
Jul 06 20:33:49.729201 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.729129    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-v8wr9_cffd6c27-1efe-47e3-86d1-c2d1b0a7b792/kube-rbac-proxy-main/0.log"
Jul 06 20:33:49.772143 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.772111    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-v8wr9_cffd6c27-1efe-47e3-86d1-c2d1b0a7b792/kube-rbac-proxy-self/0.log"
Jul 06 20:33:49.801394 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:49.801329    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-v8wr9_cffd6c27-1efe-47e3-86d1-c2d1b0a7b792/openshift-state-metrics/0.log"
Jul 06 20:33:50.273068 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.273038    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6989489c6f-mj2fr_90db7674-94b5-4c1a-b93d-cc16a8ed3249/thanos-query/0.log"
Jul 06 20:33:50.302755 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.302719    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6989489c6f-mj2fr_90db7674-94b5-4c1a-b93d-cc16a8ed3249/kube-rbac-proxy-web/0.log"
Jul 06 20:33:50.333254 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.333228    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6989489c6f-mj2fr_90db7674-94b5-4c1a-b93d-cc16a8ed3249/kube-rbac-proxy/0.log"
Jul 06 20:33:50.363802 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.363769    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6989489c6f-mj2fr_90db7674-94b5-4c1a-b93d-cc16a8ed3249/prom-label-proxy/0.log"
Jul 06 20:33:50.393571 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.393546    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6989489c6f-mj2fr_90db7674-94b5-4c1a-b93d-cc16a8ed3249/kube-rbac-proxy-rules/0.log"
Jul 06 20:33:50.418914 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.418887    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6989489c6f-mj2fr_90db7674-94b5-4c1a-b93d-cc16a8ed3249/kube-rbac-proxy-metrics/0.log"
Jul 06 20:33:50.899692 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.899656    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"]
Jul 06 20:33:50.906934 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.906899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:50.918405 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.918352    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"]
Jul 06 20:33:50.983984 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.983936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-sys\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:50.984189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.984006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-podres\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:50.984189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.984039    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7g49\" (UniqueName: \"kubernetes.io/projected/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-kube-api-access-d7g49\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:50.984189 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.984074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-proc\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:50.984316 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:50.984224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-lib-modules\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084773 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-sys\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-podres\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7g49\" (UniqueName: \"kubernetes.io/projected/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-kube-api-access-d7g49\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-proc\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084887    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-sys\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-lib-modules\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.084980 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-podres\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.085224 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.085013    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-lib-modules\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.085224 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.084975    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-proc\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.097052 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.097012    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7g49\" (UniqueName: \"kubernetes.io/projected/6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd-kube-api-access-d7g49\") pod \"perf-node-gather-daemonset-4v7h9\" (UID: \"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd\") " pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.224388 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.224285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:51.409931 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:51.409895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"]
Jul 06 20:33:52.133602 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:52.133562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9" event={"ID":"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd","Type":"ContainerStarted","Data":"aa5f70cc239dc36d22b1f31f1adffff73210187f65652ed6dad4712c1d8d7d6b"}
Jul 06 20:33:52.133791 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:52.133629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9" event={"ID":"6a4bcdfa-1ac8-4425-a737-3fbef7fde4dd","Type":"ContainerStarted","Data":"1d2e8b8308b59e52c4960f48c2e46ffbd49558c4e6a70ba25d2988c74691aad0"}
Jul 06 20:33:52.133791 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:52.133715    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:52.152650 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:52.152593    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9" podStartSLOduration=2.152575433 podStartE2EDuration="2.152575433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:33:52.150757449 +0000 UTC m=+2571.534416193" watchObservedRunningTime="2026-07-06 20:33:52.152575433 +0000 UTC m=+2571.536234182"
Jul 06 20:33:52.159854 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:52.159818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/1.log"
Jul 06 20:33:52.165916 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:52.165886    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5lnsq_0086c444-b11c-46bd-8633-645ef7f30846/console-operator/2.log"
Jul 06 20:33:53.411510 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:53.411475    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-576n7_1ef9b330-0c0d-4e73-b91e-6c4511246202/volume-data-source-validator/0.log"
Jul 06 20:33:54.741965 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:54.741931    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zrbbp_6f354a22-d010-4046-ad58-42edce5e8032/dns/0.log"
Jul 06 20:33:54.773829 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:54.773800    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zrbbp_6f354a22-d010-4046-ad58-42edce5e8032/kube-rbac-proxy/0.log"
Jul 06 20:33:54.867693 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:54.867647    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s7p65_47de195d-218a-4489-9e81-d587a196ae7f/dns-node-resolver/0.log"
Jul 06 20:33:55.518289 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:55.518262    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sqwmf_3f7ce1ef-fedf-498b-87fe-9b898c13fb77/node-ca/0.log"
Jul 06 20:33:56.624993 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:56.624960    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxw5q_6e59f972-4a34-4543-8818-9d4a0b9f389c/istio-proxy/0.log"
Jul 06 20:33:56.783923 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:56.783890    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf55b576c-94ghc_3f5553ba-7139-42ee-916f-10f85f747ca8/kube-auth-proxy/0.log"
Jul 06 20:33:56.861103 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:56.861071    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/0.log"
Jul 06 20:33:56.895976 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:56.895863    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/1.log"
Jul 06 20:33:57.076019 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:57.075984    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d5fdddbfc-xwvqf_14d488ca-2078-490c-bab3-34e4044b0c7a/router/0.log"
Jul 06 20:33:57.908123 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:57.908040    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-29kdl_341589de-3337-415a-a791-37875cd49f36/serve-healthcheck-canary/0.log"
Jul 06 20:33:58.153528 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:58.153493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5jzwh/perf-node-gather-daemonset-4v7h9"
Jul 06 20:33:58.627012 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:58.626986    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-r5dtb_79d39e8d-7fd5-4c0e-9259-559e644c186c/insights-operator/0.log"
Jul 06 20:33:58.627535 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:58.627518    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-r5dtb_79d39e8d-7fd5-4c0e-9259-559e644c186c/insights-operator/1.log"
Jul 06 20:33:58.666127 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:58.666096    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lrcz_31805ed6-206c-4c30-9e5b-2793c0a2f62f/kube-rbac-proxy/0.log"
Jul 06 20:33:58.707298 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:58.707273    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lrcz_31805ed6-206c-4c30-9e5b-2793c0a2f62f/exporter/0.log"
Jul 06 20:33:58.751183 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:33:58.751148    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lrcz_31805ed6-206c-4c30-9e5b-2793c0a2f62f/extractor/0.log"
Jul 06 20:34:01.732460 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:01.732341    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-679cc_156198ce-4a5d-425e-8a60-7e04d566a21e/manager/0.log"
Jul 06 20:34:01.732959 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:01.732542    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-679cc_156198ce-4a5d-425e-8a60-7e04d566a21e/manager/1.log"
Jul 06 20:34:01.794766 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:01.794736    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tvrs2_5644e8a4-0902-4360-b2a9-80d8ec61c0c5/manager/0.log"
Jul 06 20:34:01.918968 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:01.918936    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tvrs2_5644e8a4-0902-4360-b2a9-80d8ec61c0c5/manager/1.log"
Jul 06 20:34:01.977077 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:01.977050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxw5q_6e59f972-4a34-4543-8818-9d4a0b9f389c/istio-proxy/0.log"
Jul 06 20:34:02.117775 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:02.117727    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf55b576c-94ghc_3f5553ba-7139-42ee-916f-10f85f747ca8/kube-auth-proxy/0.log"
Jul 06 20:34:02.187666 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:02.187634    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/0.log"
Jul 06 20:34:02.219001 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:02.218964    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/1.log"
Jul 06 20:34:02.383845 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:02.383770    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d5fdddbfc-xwvqf_14d488ca-2078-490c-bab3-34e4044b0c7a/router/0.log"
Jul 06 20:34:02.613765 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:02.613727    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549b57869c-ltkkm_93437268-e618-4314-91bb-fbb67fd27994/manager/0.log"
Jul 06 20:34:02.637562 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:02.637480    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549b57869c-ltkkm_93437268-e618-4314-91bb-fbb67fd27994/copy-manifests/0.log"
Jul 06 20:34:03.658119 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:03.658091    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kxw5q_6e59f972-4a34-4543-8818-9d4a0b9f389c/istio-proxy/0.log"
Jul 06 20:34:03.792757 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:03.792727    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf55b576c-94ghc_3f5553ba-7139-42ee-916f-10f85f747ca8/kube-auth-proxy/0.log"
Jul 06 20:34:03.855752 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:03.855718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/0.log"
Jul 06 20:34:03.886859 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:03.886824    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-njvch_932037f1-5834-45ab-a761-4dea76f922f1/istio-proxy/1.log"
Jul 06 20:34:04.044397 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:04.044289    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d5fdddbfc-xwvqf_14d488ca-2078-490c-bab3-34e4044b0c7a/router/0.log"
Jul 06 20:34:04.229835 ip-10-0-142-134 kubenswrapper[2581]: I0706 20:34:04.229806    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-swk8r_23778d7d-0902-42a5-9817-5ab3dfe4c31a/openshift-lws-operator/0.log"