Jul 24 01:28:03.618433 ip-10-0-142-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 01:28:03.618447 ip-10-0-142-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 01:28:03.618466 ip-10-0-142-39 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 01:28:03.618790 ip-10-0-142-39 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 01:28:13.754018 ip-10-0-142-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 01:28:13.754036 ip-10-0-142-39 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8e380ed1f7174504be00d88b44287d7d --
Jul 24 01:29:46.841335 ip-10-0-142-39 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 01:29:47.303315 ip-10-0-142-39 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 01:29:47.303315 ip-10-0-142-39 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 01:29:47.303315 ip-10-0-142-39 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 01:29:47.303315 ip-10-0-142-39 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 01:29:47.303315 ip-10-0-142-39 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 01:29:47.305427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.305347    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 01:29:47.311758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311737    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 01:29:47.311758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311755    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 01:29:47.311758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311759    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 01:29:47.311758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311764    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311768    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311772    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311775    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311777    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311780    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311783    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311787    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311791    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311794    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311797    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311799    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311802    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311805    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311807    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311810    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311813    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311816    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311819    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 01:29:47.311925 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311821    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311824    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311826    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311829    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311831    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311834    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311837    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311840    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311843    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311845    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311849    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311851    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311854    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311857    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311859    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311862    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311865    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311867    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311870    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311872    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 01:29:47.312419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311875    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311877    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311880    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311882    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311885    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311887    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311890    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311893    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311896    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311898    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311901    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311903    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311906    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311908    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311911    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311914    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311916    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311919    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311922    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311924    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 01:29:47.312914 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311927    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311930    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311934    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311938    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311941    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311944    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311946    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311949    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311952    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311955    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311958    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311960    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311963    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311965    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311968    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311970    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311973    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311976    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311979    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 01:29:47.313420 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311981    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311984    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311987    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311989    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311992    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311995    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.311999    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312001    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312004    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312008    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312011    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312014    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312016    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312019    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312021    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312024    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312027    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312029    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312773    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312780    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 01:29:47.313882 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312784    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312787    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312790    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312793    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312796    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312799    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312802    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312804    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312807    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312809    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312812    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312814    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312817    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312820    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312822    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312826    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312829    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312832    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312835    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312837    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 01:29:47.314366 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312842    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312845    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312848    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312851    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312854    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312856    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312859    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312862    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312865    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312868    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312871    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312874    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312876    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312880    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312883    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312885    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312888    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312890    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312893    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312895    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 01:29:47.314869 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312898    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312902    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312905    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312908    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312910    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312913    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312916    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312918    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312922    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312925    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312928    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312931    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312933    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312936    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312938    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312941    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312943    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312946    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312949    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312951    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 01:29:47.315367 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312954    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312956    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312959    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312961    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312964    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312967    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312969    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312972    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312975    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312977    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312980    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312982    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312985    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312987    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312990    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312992    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312995    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.312998    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313000    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 01:29:47.315880 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313002    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313005    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313009    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313011    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313014    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313017    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313019    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313022    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313025    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313028    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313031    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313033    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313036    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313038    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313041    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313045    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313048    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313050    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313471    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313477    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 01:29:47.316347 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313480    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313483    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313486    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313489    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313492    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313494    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313497    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313500    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313502    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313505    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313507    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313510    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313513    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313516    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313519    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313525    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313527    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313530    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313532    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313535    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 01:29:47.316826 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313537    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313540    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313542    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313545    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313547    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313550    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313552    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313555    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313557    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313560    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313562    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313565    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313568    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313571    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313574    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313576    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313579    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313581    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313584    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313586    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 01:29:47.317370 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313589    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313591    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313594    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313597    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313599    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313602    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313606    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313613    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313616    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313619    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313622    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313625    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313627    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313630    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313633    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313636    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313639    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313642    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313644    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313647    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 01:29:47.317863 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313650    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313653    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313655    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313658    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313661    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313663    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313666    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313668    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313672    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313676    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313679    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313681    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313684    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313686    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313689    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313691    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313694    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313697    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313699    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 01:29:47.318391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313705    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313709    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313712    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313715    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313718    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313721    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313723    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313726    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313728    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313731    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313733    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313736    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313738    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313741    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313743    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313746    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313749    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.313751    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313830    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313848    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 01:29:47.318842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313859    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313865    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313871    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313875    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313880    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313884    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313887    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313890    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313894    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313898    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313901    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313904    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313908    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313911    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313915    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313918    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313923    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313925    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313928    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313931    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313935    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313938    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313941    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 01:29:47.319333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313944    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313948    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313951    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313954    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313957    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313960    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313963    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313967    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313970    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313973    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313976    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313979    2568 flags.go:64] FLAG: --enable-server="true"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313981    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313986    2568 flags.go:64] FLAG: --event-burst="100"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313989    2568 flags.go:64] FLAG: --event-qps="50"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313991    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313994    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.313997    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314003    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314006    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314009    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314012    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314016    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314019    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314022    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 01:29:47.319896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314025    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314028    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314031    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314033    2568 flags.go:64] FLAG: --feature-gates=""
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314037    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314040    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314043    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314046    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314049    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314052    2568 flags.go:64] FLAG: --help="false"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314055    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314058    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314061    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314064    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314067    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314071    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314073    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314076    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314079    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314082    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314084    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314088    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314090    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314093    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 01:29:47.320567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314096    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314100    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314103    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314106    2568 flags.go:64] FLAG: --lock-file=""
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314109    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314112    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314114    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314119    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314123    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314126    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314129    2568 flags.go:64] FLAG: --logging-format="text"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314131    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314135    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314137    2568 flags.go:64] FLAG: --manifest-url=""
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314140    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314145    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314147    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314151    2568 flags.go:64] FLAG: --max-pods="110"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314154    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314157    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314160    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314163    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314166    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314169    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314171    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 01:29:47.321154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314191    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314194    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314199    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314204    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314209    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314217    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314220    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314223    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314228    2568 flags.go:64] FLAG: --port="10250"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314230    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314233    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a40586cec9d5efc5"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314236    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314239    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314243    2568 flags.go:64] FLAG: --register-node="true"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314245    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314249    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314253    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314256    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314259    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314263    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314266    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314269    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314272    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314275    2568 flags.go:64] FLAG: --runonce="false"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314277    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 01:29:47.321821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314280    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314283    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314286    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314289    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314292    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314297    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314300    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314302    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314305    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314308    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314311    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314314    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314317    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314320    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314325    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314329    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314332    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314336    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314339    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314342    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314345    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314348    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314351    2568 flags.go:64] FLAG: --v="2"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314355    2568 flags.go:64] FLAG: --version="false"
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314360    2568 flags.go:64] FLAG: --vmodule=""
Jul 24 01:29:47.322476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314364    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.314367    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314497    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314501    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314504    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314507    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314510    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314513    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314515    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314518    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314521    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314523    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314528    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314530    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314533    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314537    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314540    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314544    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314547    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 01:29:47.323068 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314550    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314552    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314555    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314558    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314561    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314564    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314567    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314569    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314573    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314576    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314579    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314582    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314585    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314589    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314592    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314594    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314597    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314599    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314602    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314605    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 01:29:47.323550 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314608    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314611    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314613    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314616    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314619    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314623    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314626    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314628    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314631    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314633    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314636    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314639    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314641    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314644    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314646    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314649    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314651    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314654    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314656    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314659    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 01:29:47.324038 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314661    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314664    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314667    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314669    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314672    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314674    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314683    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314685    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314688    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314691    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314693    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314696    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314698    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314701    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314703    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314706    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314708    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314712    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314714    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314717    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 01:29:47.324547 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314719    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314722    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314724    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314728    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314731    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314734    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314737    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314739    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314742    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314744    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314747    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314749    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314752    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314754    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314757    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314759    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314762    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314764    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314767    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314775    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 01:29:47.325025 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314778    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.314780    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.315482    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.322826    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.322841    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.322861    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.322867    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322922    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322927    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322930    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322934    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322937    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322940    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322942    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322945    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 01:29:47.325575 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322947    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322950    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322952    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322955    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322957    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322960    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322962    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322965    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322969    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322972    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322976    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322978    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322981    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322984    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322986    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322989    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322991    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322994    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322996    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 01:29:47.325949 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.322998    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323003    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323007    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323010    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323013    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323016    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323018    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323021    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323024    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323026    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323029    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323032    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323034    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323037    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323040    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323042    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323044    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323047    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323049    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 01:29:47.326421 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323052    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323055    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323057    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323060    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323063    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323065    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323068    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323070    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323074    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323076    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323079    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323082    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323084    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323087    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323089    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323092    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323095    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323097    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323100    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323103    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 01:29:47.326865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323105    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323108    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323111    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323113    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323116    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323118    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323121    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323123    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323126    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323129    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323131    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323133    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323136    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323138    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323141    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323143    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323146    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323148    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323151    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323154    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 01:29:47.327407 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323156    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323158    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323161    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323163    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323165    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323169    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323187    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323190    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323193    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323197    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323199    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323202    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323205    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.323211    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323336    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 01:29:47.327901 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323341    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323344    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323347    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323350    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323352    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323355    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323357    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323360    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323362    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323364    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323367    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323369    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323372    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323375    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323377    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323380    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323382    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323385    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323387    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323389    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 01:29:47.328291 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323392    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323394    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323396    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323399    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323401    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323404    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323406    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323410    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323414    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323417    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323419    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323422    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323425    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323427    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323430    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323432    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323435    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323437    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323439    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 01:29:47.328758 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323442    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323444    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323454    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323458    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323460    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323463    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323466    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323468    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323471    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323473    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323476    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323478    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323480    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323483    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323485    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323488    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323490    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323493    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323495    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323498    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 01:29:47.329297 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323500    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323504    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323506    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323509    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323511    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323514    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323516    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323518    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323521    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323523    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323526    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323528    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323532    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323535    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323537    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323540    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323542    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323545    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323547    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323550    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 01:29:47.329764 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323553    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323556    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323559    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323562    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323566    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323569    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323572    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323575    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323578    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323581    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323585    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323587    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323590    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323593    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323596    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323598    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323601    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323603    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 01:29:47.330253 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:47.323606    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 01:29:47.330679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.323610    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 01:29:47.330679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.323717    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 01:29:47.330679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.327015    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 01:29:47.330679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.328756    2568 server.go:1019] "Starting client certificate rotation"
Jul 24 01:29:47.330679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.328855    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 01:29:47.330679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.328884    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 01:29:47.331717 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.331704    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 01:29:47.334927 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.334905    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 01:29:47.344285 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.344268    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 24 01:29:47.346835 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.346822    2568 log.go:25] "Validated CRI v1 image API"
Jul 24 01:29:47.349111 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.349090    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 01:29:47.351733 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.351716    2568 fs.go:135] Filesystem UUIDs: map[6b7927f3-d70c-4bb9-a685-aa0aacfc0d09:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c7d3f767-ac22-4e24-98ba-ad7359012477:/dev/nvme0n1p3]
Jul 24 01:29:47.351788 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.351733    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 01:29:47.356881 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.356767    2568 manager.go:216] Machine: {Timestamp:2026-07-24 01:29:47.355360703 +0000 UTC m=+0.379759170 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097579 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b7bc8b27236753c9b2ce91f8fd733 SystemUUID:ec2b7bc8-b272-3675-3c9b-2ce91f8fd733 BootID:8e380ed1-f717-4504-be00-d88b44287d7d Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:57:8c:97:21:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:57:8c:97:21:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:70:23:fb:44:04 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 01:29:47.356881 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.356876    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 01:29:47.356983 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.356977    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 01:29:47.360460 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.360441    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 01:29:47.360567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.360544    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 01:29:47.360722 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.360574    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 01:29:47.361326 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.361315    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 01:29:47.361357 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.361329    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 01:29:47.361357 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.361336    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 01:29:47.361949 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.361934    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 01:29:47.363221 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.363210    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 01:29:47.365078 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365066    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 01:29:47.365201 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365191    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 01:29:47.365240 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365221    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 01:29:47.365240 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365231    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 01:29:47.365296 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365241    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 01:29:47.365296 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365250    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 24 01:29:47.365296 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365258    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 01:29:47.365601 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365589    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 01:29:47.365644 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.365615    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 01:29:47.367939 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.367923    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 01:29:47.370208 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.370193    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 01:29:47.370294 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.370230    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 01:29:47.372327 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372313    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372333    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372342    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372350    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372363    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372372    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372384    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 01:29:47.372390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372392    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 01:29:47.372614 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372412    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 01:29:47.372614 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372421    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 01:29:47.372614 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372439    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 01:29:47.372614 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.372447    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 01:29:47.373354 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.373344    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 01:29:47.373411 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.373357    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 01:29:47.376358 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.376342    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 01:29:47.376495 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.376478    2568 server.go:1268] "Started kubelet"
Jul 24 01:29:47.377082 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.377038    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 01:29:47.377224 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.377090    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 01:29:47.377224 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.377191    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 01:29:47.377330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.377286    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qwtkq"
Jul 24 01:29:47.377734 ip-10-0-142-39 systemd[1]: Started Kubernetes Kubelet.
Jul 24 01:29:47.378531 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.378492    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 01:29:47.378586 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.378573    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 01:29:47.379722 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.379703    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 01:29:47.380938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.380923    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 01:29:47.382170 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.382154    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qwtkq"
Jul 24 01:29:47.382497 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.382479    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 01:29:47.389431 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.388277    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-39.ec2.internal.18c5159c1196e9da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-39.ec2.internal,UID:ip-10-0-142-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-39.ec2.internal,},FirstTimestamp:2026-07-24 01:29:47.376454106 +0000 UTC m=+0.400852574,LastTimestamp:2026-07-24 01:29:47.376454106 +0000 UTC m=+0.400852574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-39.ec2.internal,}"
Jul 24 01:29:47.395117 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.395089    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 01:29:47.395117 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.395102    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 01:29:47.395251 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.395169    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.395940 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.395925    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 01:29:47.396107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396095    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 01:29:47.396191 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396058    2568 factory.go:55] Registering systemd factory
Jul 24 01:29:47.396191 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396151    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 24 01:29:47.396298 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396079    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 01:29:47.396298 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396280    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 01:29:47.396298 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396289    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 01:29:47.396409 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396368    2568 factory.go:153] Registering CRI-O factory
Jul 24 01:29:47.396409 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396382    2568 factory.go:223] Registration of the crio container factory successfully
Jul 24 01:29:47.396474 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396440    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 01:29:47.396474 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396461    2568 factory.go:103] Registering Raw factory
Jul 24 01:29:47.396474 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.396472    2568 manager.go:1196] Started watching for new ooms in manager
Jul 24 01:29:47.397747 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.397732    2568 manager.go:349] Starting recovery of all containers
Jul 24 01:29:47.405072 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.405049    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 01:29:47.407140 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.407126    2568 manager.go:354] Recovery completed
Jul 24 01:29:47.407827 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.407810    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-39.ec2.internal\" not found" node="ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.411351 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.411340    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.412983 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.412970    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.413035 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.412996    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.413035 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.413007    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.413551 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.413538    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 01:29:47.413551 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.413550    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.413551 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.413551    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 01:29:47.413708 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.413571    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 01:29:47.414160 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.414147    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.414219 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.414186    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.414219 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.414200    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.415341 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.415327    2568 policy_none.go:49] "None policy: Start"
Jul 24 01:29:47.415413 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.415346    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 01:29:47.415413 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.415359    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 01:29:47.416348 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.416335    2568 policy_none.go:47] "Start"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.450562    2568 manager.go:337] "Starting Device Plugin manager"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.450742    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.450756    2568 server.go:87] "Starting device plugin registration server"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.450974    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.450984    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.451085    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.451206    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.451215    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.452883    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 01:29:47.473132 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.452946    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.497342 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.497306    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 01:29:47.498492 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.498478    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 01:29:47.498602 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.498515    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 01:29:47.498602 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.498534    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 01:29:47.498602 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.498563    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 01:29:47.500872 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.500851    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 01:29:47.551845 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.551822    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.552792 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.552769    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.552916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.552807    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.552916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.552822    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.552916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.552852    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.560844 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.560800    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.560844 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.560821    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-39.ec2.internal\": node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.572915 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.572893    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.599294 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.599269    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"]
Jul 24 01:29:47.599405 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.599339    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.600206 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.600170    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.600300 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.600220    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.600300 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.600231    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.602475 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.602462    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.602575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.602562    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.602615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.602589    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.603107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.603094    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.603107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.603101    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.603225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.603117    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.603225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.603123    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.603225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.603127    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.603225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.603137    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.605335 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.605322    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.605412 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.605346    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 01:29:47.606018 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.606000    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 01:29:47.606071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.606035    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 01:29:47.606071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.606051    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 24 01:29:47.625794 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.625777    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-39.ec2.internal\" not found" node="ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.629774 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.629760    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-39.ec2.internal\" not found" node="ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.673576 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.673539    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.698061 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.698033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8decce8947ebdef4b04d5b6c110a2999-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"8decce8947ebdef4b04d5b6c110a2999\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.698159 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.698067    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8decce8947ebdef4b04d5b6c110a2999-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"8decce8947ebdef4b04d5b6c110a2999\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.698159 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.698087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f5849b1db054671471ad846da70fb01-config\") pod \"kube-apiserver-proxy-ip-10-0-142-39.ec2.internal\" (UID: \"4f5849b1db054671471ad846da70fb01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.774210 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.774162    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.798903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.798876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8decce8947ebdef4b04d5b6c110a2999-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"8decce8947ebdef4b04d5b6c110a2999\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.799009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.798904    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8decce8947ebdef4b04d5b6c110a2999-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"8decce8947ebdef4b04d5b6c110a2999\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.799009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.798922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8decce8947ebdef4b04d5b6c110a2999-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"8decce8947ebdef4b04d5b6c110a2999\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.799009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.798947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f5849b1db054671471ad846da70fb01-config\") pod \"kube-apiserver-proxy-ip-10-0-142-39.ec2.internal\" (UID: \"4f5849b1db054671471ad846da70fb01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.799009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.798972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8decce8947ebdef4b04d5b6c110a2999-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"8decce8947ebdef4b04d5b6c110a2999\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.799009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.798985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f5849b1db054671471ad846da70fb01-config\") pod \"kube-apiserver-proxy-ip-10-0-142-39.ec2.internal\" (UID: \"4f5849b1db054671471ad846da70fb01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.875383 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.875316    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:47.931015 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.930975    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.934402 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:47.934385    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:47.975730 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:47.975701    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.081668 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:48.081628    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.183164 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:48.183089    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.289280 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:48.289241    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.328668 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.328644    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 01:29:48.329126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.328831    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 01:29:48.329126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.328827    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 01:29:48.387975 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.387931    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 01:24:48 +0000 UTC" deadline="2028-04-30 01:34:13.958044144 +0000 UTC"
Jul 24 01:29:48.387975 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.387969    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15504h4m25.570079363s"
Jul 24 01:29:48.389306 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:48.389285    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.490293 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:48.490215    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.539294 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:48.539253    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8decce8947ebdef4b04d5b6c110a2999.slice/crio-7a8ee1a934d2f55e256ba1f6cf0c04d64d26b5520d7a882064fd665ea57e3b37 WatchSource:0}: Error finding container 7a8ee1a934d2f55e256ba1f6cf0c04d64d26b5520d7a882064fd665ea57e3b37: Status 404 returned error can't find the container with id 7a8ee1a934d2f55e256ba1f6cf0c04d64d26b5520d7a882064fd665ea57e3b37
Jul 24 01:29:48.539677 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:48.539657    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5849b1db054671471ad846da70fb01.slice/crio-e44980c8fb18dc350f1d93cad9e84c729554bf949141bf53af33753a986d7f5f WatchSource:0}: Error finding container e44980c8fb18dc350f1d93cad9e84c729554bf949141bf53af33753a986d7f5f: Status 404 returned error can't find the container with id e44980c8fb18dc350f1d93cad9e84c729554bf949141bf53af33753a986d7f5f
Jul 24 01:29:48.543435 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.543405    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 01:29:48.591392 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:48.591365    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 24 01:29:48.603663 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.603640    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 01:29:48.695639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.695607    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:48.706079 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.706059    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 01:29:48.707969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.707954    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 24 01:29:48.716277 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.716259    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 01:29:48.950243 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:48.950153    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 01:29:49.367283 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.367172    2568 apiserver.go:52] "Watching apiserver"
Jul 24 01:29:49.374218 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.374179    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 01:29:49.376409 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.376379    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-4k6tm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal","openshift-multus/network-metrics-daemon-qj6hm","openshift-ovn-kubernetes/ovnkube-node-n4tm4","kube-system/konnectivity-agent-49pmx","kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7","openshift-multus/multus-additional-cni-plugins-28zrg","openshift-multus/multus-j6w46","openshift-network-diagnostics/network-check-target-2b5xp","openshift-network-operator/iptables-alerter-qk8q4","kube-system/global-pull-secret-syncer-h2n47","openshift-cluster-node-tuning-operator/tuned-k42kw","openshift-dns/node-resolver-rvrxj"]
Jul 24 01:29:49.381515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.379417    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.381970 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.381949    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.382823 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.382614    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 01:29:49.382823 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.382643    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.382823 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.382636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-82jpg\""
Jul 24 01:29:49.384465 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.383847    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.384465 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.384191    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qxrd4\""
Jul 24 01:29:49.384465 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.384421    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.384679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.384632    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.384797 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.384774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:49.384904 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.384867    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:29:49.387402 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.387342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.389620 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.389601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.389759 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.389650    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 01:29:49.390533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.390378    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mhpgb\""
Jul 24 01:29:49.390533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.390378    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.390656 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.390638    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 01:29:49.390656 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.390638    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 01:29:49.390759 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.390721    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.390957 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.390939    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 01:29:49.391652 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.391598    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 01:29:49.392385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.392254    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.392385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.392323    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d8b67\""
Jul 24 01:29:49.393260 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.392560    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 01:29:49.394510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.394489    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.394670 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.394651    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wgtgz\""
Jul 24 01:29:49.394754 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.394680    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.394999 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.394972    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.395391 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.395370    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 01:29:49.396962 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.396942    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.397102 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.397084    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 01:29:49.397483 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.397277    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cbtqp\""
Jul 24 01:29:49.397579 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.397550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.397661 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.397329    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 01:29:49.397791 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.397335    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.400610 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.400571    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.400708 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.400662    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.400908 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.400892    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 01:29:49.400959 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.400919    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-thcns\""
Jul 24 01:29:49.401359 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.401337    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.403315 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.402744    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 01:29:49.403315 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.403110    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 01:29:49.403315 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.403201    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n2m47\""
Jul 24 01:29:49.403315 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.403304    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:49.403638 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.403368    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:29:49.405737 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.405429    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 01:29:49.405737 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.405482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.407032 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407008    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.407126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-sys\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.407126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-ovn\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.407126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-tuned\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.407308 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407163    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkx7l\" (UniqueName: \"kubernetes.io/projected/e5759398-f84e-4ffc-9527-4249c9c4919a-kube-api-access-mkx7l\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.407308 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfw96\" (UniqueName: \"kubernetes.io/projected/ee465a91-7a71-4825-b9af-38457c725db6-kube-api-access-vfw96\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:49.407308 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/039c784d-6e15-4c07-b74b-00f8de82fae0-agent-certs\") pod \"konnectivity-agent-49pmx\" (UID: \"039c784d-6e15-4c07-b74b-00f8de82fae0\") " pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.407470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-slash\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.407470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-system-cni-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.407470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-multus-certs\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.407470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407421    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovnkube-config\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.407470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovn-node-metrics-cert\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.407719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1908820-260b-4a3a-87b6-7aaff7be860c-hosts-file\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.407719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407590    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-device-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.407719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-systemd\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.407719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-lib-modules\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.407719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-cnibin\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-daemon-config\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-etc-kubernetes\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l62pq\" (UniqueName: \"kubernetes.io/projected/4590664c-1db4-4aca-91b9-2c4b5e81d845-kube-api-access-l62pq\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-run-netns\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407809    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-host\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.407986 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.407877    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t44w7\""
Jul 24 01:29:49.408350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408001    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.408350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408021    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 01:29:49.408350 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.408058    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:29:49.408350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408095    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 01:29:49.408350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5759398-f84e-4ffc-9527-4249c9c4919a-tmp\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.408350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-kubelet\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-var-lib-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-cni-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-cni-multus\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-kubelet\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-cni-bin\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408587    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-socket-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.408625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408611    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-registration-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-cni-bin\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-k8s-cni-cncf-io\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408733    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bckj\" (UniqueName: \"kubernetes.io/projected/8679a38d-cda4-48f4-a5f2-96f8abda6f62-kube-api-access-6bckj\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408765    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysconfig\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysctl-d\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408821    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-run\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-os-release\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovnkube-script-lib\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.409071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.408977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-842m6\" (UniqueName: \"kubernetes.io/projected/a23066aa-0fd2-4fef-96e5-8c71348c2999-kube-api-access-842m6\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.409538 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.409046    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-modprobe-d\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.410760 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.410715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/039c784d-6e15-4c07-b74b-00f8de82fae0-konnectivity-ca\") pod \"konnectivity-agent-49pmx\" (UID: \"039c784d-6e15-4c07-b74b-00f8de82fae0\") " pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.410856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.410793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4590664c-1db4-4aca-91b9-2c4b5e81d845-cni-binary-copy\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.410856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.410822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-cni-netd\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.410966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.410859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-env-overrides\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.410966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.410908    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-kubernetes\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.410966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.410952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-var-lib-kubelet\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.411062 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-hostroot\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.411096 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-etc-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.411132 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23066aa-0fd2-4fef-96e5-8c71348c2999-host\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.411202 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411183    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjzdj\" (UniqueName: \"kubernetes.io/projected/08f5981d-7e0d-4185-915f-8d3194b8213a-kube-api-access-cjzdj\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.411274 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-systemd\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.411359 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411339    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-socket-dir-parent\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.411412 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.411476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7plw\" (UniqueName: \"kubernetes.io/projected/d1908820-260b-4a3a-87b6-7aaff7be860c-kube-api-access-w7plw\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.411530 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411494    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-netns\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.411856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411546    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-node-log\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.411856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a23066aa-0fd2-4fef-96e5-8c71348c2999-serviceca\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.411856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:49.411856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.411856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411825    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-conf-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.412139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.412139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411933    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-log-socket\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.412139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.411984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysctl-conf\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.412139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.412011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1908820-260b-4a3a-87b6-7aaff7be860c-tmp-dir\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.412139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.412063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-sys-fs\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.412139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.412097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-systemd-units\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.415602 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.415579    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 01:29:49.426724 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.426701    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m74kh"
Jul 24 01:29:49.435803 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.435783    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m74kh"
Jul 24 01:29:49.497398 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.497369    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 01:29:49.503375 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.503316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal" event={"ID":"4f5849b1db054671471ad846da70fb01","Type":"ContainerStarted","Data":"e44980c8fb18dc350f1d93cad9e84c729554bf949141bf53af33753a986d7f5f"}
Jul 24 01:29:49.504569 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.504538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" event={"ID":"8decce8947ebdef4b04d5b6c110a2999","Type":"ContainerStarted","Data":"7a8ee1a934d2f55e256ba1f6cf0c04d64d26b5520d7a882064fd665ea57e3b37"}
Jul 24 01:29:49.512406 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-iptables-alerter-script\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.512515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-host-slash\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.512515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512433    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-system-cni-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-multus-certs\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovnkube-config\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.512515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovn-node-metrics-cert\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.512515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1908820-260b-4a3a-87b6-7aaff7be860c-hosts-file\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-device-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-system-cni-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-multus-certs\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-systemd\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-systemd\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1908820-260b-4a3a-87b6-7aaff7be860c-hosts-file\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-lib-modules\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-cnibin\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-daemon-config\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-etc-kubernetes\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-device-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512750    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w866w\" (UniqueName: \"kubernetes.io/projected/e7771e29-58a0-4ab6-b60a-635763575225-kube-api-access-w866w\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l62pq\" (UniqueName: \"kubernetes.io/projected/4590664c-1db4-4aca-91b9-2c4b5e81d845-kube-api-access-l62pq\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.512812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512785    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-lib-modules\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512837    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-etc-kubernetes\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512887    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-cnibin\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512936    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-run-netns\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-host\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512973    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.512986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5759398-f84e-4ffc-9527-4249c9c4919a-tmp\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513015    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/428c7226-3595-46d2-b65f-88b56844aa07-dbus\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-os-release\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513316    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-host\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-kubelet\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-var-lib-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-cni-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-cni-multus\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-kubelet\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-var-lib-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.513493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-cni-bin\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-socket-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513519    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-cni-multus\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513520    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-kubelet\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-registration-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-kubelet\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-cni-bin\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513472    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-run-netns\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-k8s-cni-cncf-io\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-cni-bin\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bckj\" (UniqueName: \"kubernetes.io/projected/8679a38d-cda4-48f4-a5f2-96f8abda6f62-kube-api-access-6bckj\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513648    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-var-lib-cni-bin\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysconfig\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513119    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysctl-d\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-run\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513705    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-cni-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513723    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovnkube-config\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.514356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysconfig\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-k8s-cni-cncf-io\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-socket-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-os-release\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513795    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-run\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513822    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovnkube-script-lib\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513841    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-os-release\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513846    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysctl-d\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-842m6\" (UniqueName: \"kubernetes.io/projected/a23066aa-0fd2-4fef-96e5-8c71348c2999-kube-api-access-842m6\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-modprobe-d\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-registration-dir\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/039c784d-6e15-4c07-b74b-00f8de82fae0-konnectivity-ca\") pod \"konnectivity-agent-49pmx\" (UID: \"039c784d-6e15-4c07-b74b-00f8de82fae0\") " pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4590664c-1db4-4aca-91b9-2c4b5e81d845-cni-binary-copy\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513959    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-cni-netd\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.513986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-env-overrides\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-kubernetes\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-var-lib-kubelet\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-hostroot\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.515297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-modprobe-d\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-etc-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-cni-netd\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23066aa-0fd2-4fef-96e5-8c71348c2999-host\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514133    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjzdj\" (UniqueName: \"kubernetes.io/projected/08f5981d-7e0d-4185-915f-8d3194b8213a-kube-api-access-cjzdj\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-var-lib-kubelet\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-cnibin\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-tuning-conf-dir\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovnkube-script-lib\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514559    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/039c784d-6e15-4c07-b74b-00f8de82fae0-konnectivity-ca\") pod \"konnectivity-agent-49pmx\" (UID: \"039c784d-6e15-4c07-b74b-00f8de82fae0\") " pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23066aa-0fd2-4fef-96e5-8c71348c2999-host\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-hostroot\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514597    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-daemon-config\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8679a38d-cda4-48f4-a5f2-96f8abda6f62-env-overrides\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-etc-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4zw\" (UniqueName: \"kubernetes.io/projected/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-kube-api-access-st4zw\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4590664c-1db4-4aca-91b9-2c4b5e81d845-cni-binary-copy\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/428c7226-3595-46d2-b65f-88b56844aa07-kubelet-config\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-systemd\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-socket-dir-parent\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514683    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-kubernetes\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-systemd\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7plw\" (UniqueName: \"kubernetes.io/projected/d1908820-260b-4a3a-87b6-7aaff7be860c-kube-api-access-w7plw\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-socket-dir-parent\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-netns\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-node-log\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-host-run-netns\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514945    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-node-log\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514965    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a23066aa-0fd2-4fef-96e5-8c71348c2999-serviceca\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.514992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515091    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-conf-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.516841 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.515138    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-log-socket\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.515224    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:50.01518511 +0000 UTC m=+3.039583566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515226    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysctl-conf\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515239    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-log-socket\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4590664c-1db4-4aca-91b9-2c4b5e81d845-multus-conf-dir\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-system-cni-dir\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1908820-260b-4a3a-87b6-7aaff7be860c-tmp-dir\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515334    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-sys-fs\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-systemd-units\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515381    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-sysctl-conf\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515407    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-sys\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a23066aa-0fd2-4fef-96e5-8c71348c2999-serviceca\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.517578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515309    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-openvswitch\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515436    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/08f5981d-7e0d-4185-915f-8d3194b8213a-sys-fs\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-ovn\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-systemd-units\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5759398-f84e-4ffc-9527-4249c9c4919a-sys\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515513    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-run-ovn\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-tuned\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx7l\" (UniqueName: \"kubernetes.io/projected/e5759398-f84e-4ffc-9527-4249c9c4919a-kube-api-access-mkx7l\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfw96\" (UniqueName: \"kubernetes.io/projected/ee465a91-7a71-4825-b9af-38457c725db6-kube-api-access-vfw96\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1908820-260b-4a3a-87b6-7aaff7be860c-tmp-dir\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515620    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/039c784d-6e15-4c07-b74b-00f8de82fae0-agent-certs\") pod \"konnectivity-agent-49pmx\" (UID: \"039c784d-6e15-4c07-b74b-00f8de82fae0\") " pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-slash\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515697    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-cni-binary-copy\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.518272 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.515836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8679a38d-cda4-48f4-a5f2-96f8abda6f62-host-slash\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.516881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5759398-f84e-4ffc-9527-4249c9c4919a-tmp\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.518973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.517098    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8679a38d-cda4-48f4-a5f2-96f8abda6f62-ovn-node-metrics-cert\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.518973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.517855    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5759398-f84e-4ffc-9527-4249c9c4919a-etc-tuned\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.518973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.518577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/039c784d-6e15-4c07-b74b-00f8de82fae0-agent-certs\") pod \"konnectivity-agent-49pmx\" (UID: \"039c784d-6e15-4c07-b74b-00f8de82fae0\") " pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.521697 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.521672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l62pq\" (UniqueName: \"kubernetes.io/projected/4590664c-1db4-4aca-91b9-2c4b5e81d845-kube-api-access-l62pq\") pod \"multus-j6w46\" (UID: \"4590664c-1db4-4aca-91b9-2c4b5e81d845\") " pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.523510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.523419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bckj\" (UniqueName: \"kubernetes.io/projected/8679a38d-cda4-48f4-a5f2-96f8abda6f62-kube-api-access-6bckj\") pod \"ovnkube-node-n4tm4\" (UID: \"8679a38d-cda4-48f4-a5f2-96f8abda6f62\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.523510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.523438    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-842m6\" (UniqueName: \"kubernetes.io/projected/a23066aa-0fd2-4fef-96e5-8c71348c2999-kube-api-access-842m6\") pod \"node-ca-4k6tm\" (UID: \"a23066aa-0fd2-4fef-96e5-8c71348c2999\") " pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.527507 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.527475    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkx7l\" (UniqueName: \"kubernetes.io/projected/e5759398-f84e-4ffc-9527-4249c9c4919a-kube-api-access-mkx7l\") pod \"tuned-k42kw\" (UID: \"e5759398-f84e-4ffc-9527-4249c9c4919a\") " pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.528537 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.528510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7plw\" (UniqueName: \"kubernetes.io/projected/d1908820-260b-4a3a-87b6-7aaff7be860c-kube-api-access-w7plw\") pod \"node-resolver-rvrxj\" (UID: \"d1908820-260b-4a3a-87b6-7aaff7be860c\") " pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.528659 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.528638    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjzdj\" (UniqueName: \"kubernetes.io/projected/08f5981d-7e0d-4185-915f-8d3194b8213a-kube-api-access-cjzdj\") pod \"aws-ebs-csi-driver-node-wjwn7\" (UID: \"08f5981d-7e0d-4185-915f-8d3194b8213a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.529195 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.529145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfw96\" (UniqueName: \"kubernetes.io/projected/ee465a91-7a71-4825-b9af-38457c725db6-kube-api-access-vfw96\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:49.616683 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-cnibin\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.616874 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-tuning-conf-dir\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.616874 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616719    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4zw\" (UniqueName: \"kubernetes.io/projected/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-kube-api-access-st4zw\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.616874 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-cnibin\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.616874 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/428c7226-3595-46d2-b65f-88b56844aa07-kubelet-config\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/428c7226-3595-46d2-b65f-88b56844aa07-kubelet-config\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-system-cni-dir\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.616932    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-tuning-conf-dir\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-system-cni-dir\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-cni-binary-copy\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-iptables-alerter-script\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.617133    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617139    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-host-slash\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w866w\" (UniqueName: \"kubernetes.io/projected/e7771e29-58a0-4ab6-b60a-635763575225-kube-api-access-w866w\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.617208    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:50.117172815 +0000 UTC m=+3.141571280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617246    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/428c7226-3595-46d2-b65f-88b56844aa07-dbus\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617261    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-host-slash\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-os-release\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617391    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7771e29-58a0-4ab6-b60a-635763575225-os-release\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.617609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.618161 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617749    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.618161 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.617757    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-iptables-alerter-script\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.618161 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.618019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/428c7226-3595-46d2-b65f-88b56844aa07-dbus\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:49.618161 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.618064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7771e29-58a0-4ab6-b60a-635763575225-cni-binary-copy\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.625605 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.625582    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:29:49.625753 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.625612    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:29:49.625753 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.625626    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:49.625753 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:49.625690    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:50.125672778 +0000 UTC m=+3.150071257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:49.628340 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.628312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4zw\" (UniqueName: \"kubernetes.io/projected/14ca72b7-b2ad-4b9f-977c-ef962cfb5367-kube-api-access-st4zw\") pod \"iptables-alerter-qk8q4\" (UID: \"14ca72b7-b2ad-4b9f-977c-ef962cfb5367\") " pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.628467 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.628392    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w866w\" (UniqueName: \"kubernetes.io/projected/e7771e29-58a0-4ab6-b60a-635763575225-kube-api-access-w866w\") pod \"multus-additional-cni-plugins-28zrg\" (UID: \"e7771e29-58a0-4ab6-b60a-635763575225\") " pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.695172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.695133    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7"
Jul 24 01:29:49.704719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.704695    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k42kw"
Jul 24 01:29:49.717703 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.717678    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:29:49.724732 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.724711    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:29:49.731700 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.731673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvrxj"
Jul 24 01:29:49.738575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.738545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6w46"
Jul 24 01:29:49.746340 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.746318    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4k6tm"
Jul 24 01:29:49.755188 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.755151    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-28zrg"
Jul 24 01:29:49.761182 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.761161    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qk8q4"
Jul 24 01:29:49.844229 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:49.844196    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 01:29:50.019425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:50.019338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:50.019608 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.019528    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:50.019608 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.019592    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:51.019575512 +0000 UTC m=+4.043973968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:50.120655 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:50.120617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:50.120829 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.120787    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:50.120879 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.120868    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:51.120849443 +0000 UTC m=+4.145247900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:50.221316 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:50.221271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:50.221500 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.221458    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:29:50.221500 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.221483    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:29:50.221500 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.221495    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:50.221664 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:50.221576    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:51.221555543 +0000 UTC m=+4.245953998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:50.438743 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:50.438653    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 01:24:50 +0000 UTC" deadline="2028-01-05 05:06:03.117688577 +0000 UTC"
Jul 24 01:29:50.438743 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:50.438689    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12723h36m12.679003806s"
Jul 24 01:29:50.509453 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.509419    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c784d_6e15_4c07_b74b_00f8de82fae0.slice/crio-d770453a37007898fa4346954e90f0b0227fe0c860ccc6d03c2e5a7dc8c41dcf WatchSource:0}: Error finding container d770453a37007898fa4346954e90f0b0227fe0c860ccc6d03c2e5a7dc8c41dcf: Status 404 returned error can't find the container with id d770453a37007898fa4346954e90f0b0227fe0c860ccc6d03c2e5a7dc8c41dcf
Jul 24 01:29:50.511612 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.511586    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1908820_260b_4a3a_87b6_7aaff7be860c.slice/crio-c54f246148c82098277f9fa892e3caafea09aa944d888d053faae81fec4a6b44 WatchSource:0}: Error finding container c54f246148c82098277f9fa892e3caafea09aa944d888d053faae81fec4a6b44: Status 404 returned error can't find the container with id c54f246148c82098277f9fa892e3caafea09aa944d888d053faae81fec4a6b44
Jul 24 01:29:50.512101 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.512058    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f5981d_7e0d_4185_915f_8d3194b8213a.slice/crio-7660c9f68b4eefdaabc3aa2c86d55095176f919b716011c9eb19d6b39bd718d2 WatchSource:0}: Error finding container 7660c9f68b4eefdaabc3aa2c86d55095176f919b716011c9eb19d6b39bd718d2: Status 404 returned error can't find the container with id 7660c9f68b4eefdaabc3aa2c86d55095176f919b716011c9eb19d6b39bd718d2
Jul 24 01:29:50.512865 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.512839    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ca72b7_b2ad_4b9f_977c_ef962cfb5367.slice/crio-92dadbf8e98e4ce459884e775786f699f6d7611a38f72ab32c1b530be44089ff WatchSource:0}: Error finding container 92dadbf8e98e4ce459884e775786f699f6d7611a38f72ab32c1b530be44089ff: Status 404 returned error can't find the container with id 92dadbf8e98e4ce459884e775786f699f6d7611a38f72ab32c1b530be44089ff
Jul 24 01:29:50.514567 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.514543    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7771e29_58a0_4ab6_b60a_635763575225.slice/crio-f105fc54db96ad86284f75368ed5849a5f6989aff868dbed3e94c4cdc0a8f2b4 WatchSource:0}: Error finding container f105fc54db96ad86284f75368ed5849a5f6989aff868dbed3e94c4cdc0a8f2b4: Status 404 returned error can't find the container with id f105fc54db96ad86284f75368ed5849a5f6989aff868dbed3e94c4cdc0a8f2b4
Jul 24 01:29:50.542486 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.542467    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4590664c_1db4_4aca_91b9_2c4b5e81d845.slice/crio-1b5ed1936f2a63e204d5101843cb6fe31d706c8a20bb64852fd0f81605e7c97b WatchSource:0}: Error finding container 1b5ed1936f2a63e204d5101843cb6fe31d706c8a20bb64852fd0f81605e7c97b: Status 404 returned error can't find the container with id 1b5ed1936f2a63e204d5101843cb6fe31d706c8a20bb64852fd0f81605e7c97b
Jul 24 01:29:50.543936 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:29:50.543912    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5759398_f84e_4ffc_9527_4249c9c4919a.slice/crio-bf547c16417760f6eb3c6aeb1e0f85a63e58c4db477a9a6d651e543bdb29a12b WatchSource:0}: Error finding container bf547c16417760f6eb3c6aeb1e0f85a63e58c4db477a9a6d651e543bdb29a12b: Status 404 returned error can't find the container with id bf547c16417760f6eb3c6aeb1e0f85a63e58c4db477a9a6d651e543bdb29a12b
Jul 24 01:29:51.029157 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.028122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:51.029157 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.028578    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:51.029157 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.028651    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:53.028631223 +0000 UTC m=+6.053029684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:51.129597 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.129365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:51.129597 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.129544    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:51.129826 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.129614    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:53.129592856 +0000 UTC m=+6.153991318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:51.230855 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.230110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:51.230855 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.230378    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:29:51.230855 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.230403    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:29:51.230855 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.230417    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:51.230855 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.230484    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:53.230461636 +0000 UTC m=+6.254860096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:51.439512 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.439394    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 01:24:50 +0000 UTC" deadline="2028-02-07 11:11:31.350113498 +0000 UTC"
Jul 24 01:29:51.439512 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.439461    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13521h41m39.910656484s"
Jul 24 01:29:51.502172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.501400    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:51.502172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.501420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:51.502172 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.501549    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:29:51.502172 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.501979    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:29:51.502172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.502049    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:51.502172 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:51.502128    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:29:51.515204 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.515173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal" event={"ID":"4f5849b1db054671471ad846da70fb01","Type":"ContainerStarted","Data":"aa3458234393c32493208cdfd3ba3f6f892ce44d79dcd5aba0c67f201a359d6d"}
Jul 24 01:29:51.525835 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.525805    2568 generic.go:356] "Generic (PLEG): container finished" podID="8decce8947ebdef4b04d5b6c110a2999" containerID="a4b89f545d577a37f42dc1cd12fcbfec0c9ecc9bc9c9039203f567c82ed774e9" exitCode=0
Jul 24 01:29:51.525984 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.525903    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" event={"ID":"8decce8947ebdef4b04d5b6c110a2999","Type":"ContainerDied","Data":"a4b89f545d577a37f42dc1cd12fcbfec0c9ecc9bc9c9039203f567c82ed774e9"}
Jul 24 01:29:51.532510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.532481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k42kw" event={"ID":"e5759398-f84e-4ffc-9527-4249c9c4919a","Type":"ContainerStarted","Data":"bf547c16417760f6eb3c6aeb1e0f85a63e58c4db477a9a6d651e543bdb29a12b"}
Jul 24 01:29:51.547205 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.547124    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal" podStartSLOduration=2.547107057 podStartE2EDuration="2.547107057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:29:51.531280291 +0000 UTC m=+4.555678770" watchObservedRunningTime="2026-07-24 01:29:51.547107057 +0000 UTC m=+4.571505539"
Jul 24 01:29:51.552015 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.551988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6w46" event={"ID":"4590664c-1db4-4aca-91b9-2c4b5e81d845","Type":"ContainerStarted","Data":"1b5ed1936f2a63e204d5101843cb6fe31d706c8a20bb64852fd0f81605e7c97b"}
Jul 24 01:29:51.563169 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.563066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"37ef927637c311abd2cb285696f8d4a58607190c93f56346a48728558c2c8ba5"}
Jul 24 01:29:51.570091 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.570059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4k6tm" event={"ID":"a23066aa-0fd2-4fef-96e5-8c71348c2999","Type":"ContainerStarted","Data":"70b9f49a2665ed055dcd2f270f42fdad1ce8dc4d6c58e6b254400c7887ade90e"}
Jul 24 01:29:51.576637 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.576608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qk8q4" event={"ID":"14ca72b7-b2ad-4b9f-977c-ef962cfb5367","Type":"ContainerStarted","Data":"92dadbf8e98e4ce459884e775786f699f6d7611a38f72ab32c1b530be44089ff"}
Jul 24 01:29:51.592512 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.592483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvrxj" event={"ID":"d1908820-260b-4a3a-87b6-7aaff7be860c","Type":"ContainerStarted","Data":"c54f246148c82098277f9fa892e3caafea09aa944d888d053faae81fec4a6b44"}
Jul 24 01:29:51.624883 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.624838    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerStarted","Data":"f105fc54db96ad86284f75368ed5849a5f6989aff868dbed3e94c4cdc0a8f2b4"}
Jul 24 01:29:51.644878 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.644844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7" event={"ID":"08f5981d-7e0d-4185-915f-8d3194b8213a","Type":"ContainerStarted","Data":"7660c9f68b4eefdaabc3aa2c86d55095176f919b716011c9eb19d6b39bd718d2"}
Jul 24 01:29:51.652640 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:51.652611    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-49pmx" event={"ID":"039c784d-6e15-4c07-b74b-00f8de82fae0","Type":"ContainerStarted","Data":"d770453a37007898fa4346954e90f0b0227fe0c860ccc6d03c2e5a7dc8c41dcf"}
Jul 24 01:29:52.672913 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:52.672870    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" event={"ID":"8decce8947ebdef4b04d5b6c110a2999","Type":"ContainerStarted","Data":"537343d5a974e2c29f28d3bd3385c2b3280a7eb9549dd42a480c6a4512af1a89"}
Jul 24 01:29:52.689539 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:52.689482    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" podStartSLOduration=3.689461965 podStartE2EDuration="3.689461965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:29:52.687942261 +0000 UTC m=+5.712340744" watchObservedRunningTime="2026-07-24 01:29:52.689461965 +0000 UTC m=+5.713860446"
Jul 24 01:29:53.046843 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:53.046023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:53.046843 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.046279    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:53.046843 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.046363    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:57.046332497 +0000 UTC m=+10.070730958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:53.147945 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:53.147294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:53.147945 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.147486    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:53.147945 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.147560    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:57.147540101 +0000 UTC m=+10.171938561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:53.248769 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:53.248027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:53.248769 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.248237    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:29:53.248769 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.248265    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:29:53.248769 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.248280    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:53.248769 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.248345    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:29:57.248324222 +0000 UTC m=+10.272722684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:53.501695 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:53.501602    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:53.501870 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.501733    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:29:53.501870 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:53.501799    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:53.501985 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.501882    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:29:53.501985 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:53.501940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:53.502101 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:53.502028    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:29:55.499588 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:55.499327    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:55.499588 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:55.499474    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:29:55.499588 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:55.499496    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:55.500177 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:55.499603    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:29:55.500177 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:55.499633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:55.500177 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:55.499710    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:29:57.084295 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:57.084256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:57.084781 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.084439    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:57.084781 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.084522    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:05.084497398 +0000 UTC m=+18.108895880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:29:57.185191 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:57.185152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:57.185397 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.185323    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:57.185462 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.185406    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:05.18538261 +0000 UTC m=+18.209781073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:29:57.286245 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:57.286179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:57.286466 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.286389    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:29:57.286466 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.286413    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:29:57.286466 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.286427    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:57.286638 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.286488    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:05.286468785 +0000 UTC m=+18.310867261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:29:57.499237 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:57.499050    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:57.499237 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.499191    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:29:57.500479 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:57.500454    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:57.500648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:57.500547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:57.500648 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.500591    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:29:57.500648 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:57.500631    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:29:59.499908 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:59.499874    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:29:59.500381 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:59.499944    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:29:59.500381 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:29:59.499951    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:29:59.500381 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:59.500048    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:29:59.500539 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:59.500481    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:29:59.500614 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:29:59.500571    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:01.499611 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:01.499571    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:01.499611 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:01.499605    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:01.500057 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:01.499571    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:01.500057 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:01.499710    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:01.500057 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:01.499785    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:01.500057 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:01.499857    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:03.498982 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:03.498943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:03.498982 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:03.498964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:03.499502 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:03.498945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:03.499502 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:03.499063    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:03.499502 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:03.499169    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:03.499502 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:03.499309    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:05.147035 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:05.147000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:05.147511 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.147114    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:30:05.147511 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.147166    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:21.147153255 +0000 UTC m=+34.171551710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:30:05.247664 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:05.247622    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:05.247822 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.247728    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:30:05.247822 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.247777    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:21.247763879 +0000 UTC m=+34.272162334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:30:05.348684 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:05.348641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:05.348838 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.348795    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:30:05.348838 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.348812    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:30:05.348838 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.348821    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:30:05.348965 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.348870    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:21.348856229 +0000 UTC m=+34.373254685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:30:05.498875 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:05.498785    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:05.499041 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:05.498789    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:05.499041 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.498925    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:05.499041 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.499030    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:05.499232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:05.498789    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:05.499232 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:05.499122    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:07.500145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:07.500114    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:07.500615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:07.500231    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:07.500615 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:07.500356    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:07.500615 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:07.500237    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:07.500615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:07.500406    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:07.500615 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:07.500494    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:09.499240 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.498834    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:09.500012 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.498896    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:09.500012 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:09.499366    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:09.500012 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:09.499464    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:09.500012 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.498902    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:09.500012 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:09.499566    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:09.706917 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.706883    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7" event={"ID":"08f5981d-7e0d-4185-915f-8d3194b8213a","Type":"ContainerStarted","Data":"4ca8a9d32f6f53fa63518cc6f27859d8119eaa27f6ff06b95f536b937f58ba27"}
Jul 24 01:30:09.708224 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.708198    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-49pmx" event={"ID":"039c784d-6e15-4c07-b74b-00f8de82fae0","Type":"ContainerStarted","Data":"2627965128f545195c0fa5de1f80010f201f1be3cc570b9448f38efd1d6d0e49"}
Jul 24 01:30:09.709639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.709616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k42kw" event={"ID":"e5759398-f84e-4ffc-9527-4249c9c4919a","Type":"ContainerStarted","Data":"40722c799e6ca7e859ca02a68ef7610ad8bbc7c0f80d5f39b8dd39220ad33a86"}
Jul 24 01:30:09.711037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.711017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6w46" event={"ID":"4590664c-1db4-4aca-91b9-2c4b5e81d845","Type":"ContainerStarted","Data":"4b4e232988e415e2b52470a80d89c2e133a215d306a6b25c61e6ac3e8926e24f"}
Jul 24 01:30:09.713859 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.713839    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"71b8c5bf87f1dd9674c88b6789d2330cf5f4e2e3aa3b5b657aca942d1e992889"}
Jul 24 01:30:09.713951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.713934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"3a94371cd84fdb73170fa4125664fb5783b5b9d3fa5075109524004314462689"}
Jul 24 01:30:09.714001 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.713984    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"d2299f9497a8c730f0017ea0dca6fbfcba7278991644283d6475d5e1c676de6c"}
Jul 24 01:30:09.714039 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.714014    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"b2264d289906cd3b83900c7530d6ab8e3a1b71b8483c5c17f84a0edae990c79e"}
Jul 24 01:30:09.714078 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.714049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"e1f067e43378ce8a755c1efd753b75113c3ae772da9e5c63a94db31587497425"}
Jul 24 01:30:09.715283 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.715260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4k6tm" event={"ID":"a23066aa-0fd2-4fef-96e5-8c71348c2999","Type":"ContainerStarted","Data":"ebdc40ff407a497d8a2792089c6eb56aef2147344fb776bfda4931196c2fd819"}
Jul 24 01:30:09.716547 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.716526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvrxj" event={"ID":"d1908820-260b-4a3a-87b6-7aaff7be860c","Type":"ContainerStarted","Data":"545aedab85a7ae8d7ca2b7ad5652926a5b7998ebcaf7939d71f2a2763f27ade9"}
Jul 24 01:30:09.718008 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.717988    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7771e29-58a0-4ab6-b60a-635763575225" containerID="d5252dd63b5d76bac1ea8324b26d12ae19cd0ba3bcba6b200d3f94ef6224db0e" exitCode=0
Jul 24 01:30:09.718112 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.718015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerDied","Data":"d5252dd63b5d76bac1ea8324b26d12ae19cd0ba3bcba6b200d3f94ef6224db0e"}
Jul 24 01:30:09.721519 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.721481    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-49pmx" podStartSLOduration=10.812811225 podStartE2EDuration="21.721470323s" totalImagesPullingTime="10.908659098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:09.721232597 +0000 UTC m=+22.745631070" watchObservedRunningTime="2026-07-24 01:30:09.721470323 +0000 UTC m=+22.745868799"
Jul 24 01:30:09.733377 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.733341    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rvrxj" podStartSLOduration=3.088972519 podStartE2EDuration="21.733328782s" totalImagesPullingTime="18.644356263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:09.733268777 +0000 UTC m=+22.757667264" watchObservedRunningTime="2026-07-24 01:30:09.733328782 +0000 UTC m=+22.757727258"
Jul 24 01:30:09.746896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.746858    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4k6tm" podStartSLOduration=3.131428422 podStartE2EDuration="21.746845505s" totalImagesPullingTime="18.615417083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:09.746705743 +0000 UTC m=+22.771104219" watchObservedRunningTime="2026-07-24 01:30:09.746845505 +0000 UTC m=+22.771243982"
Jul 24 01:30:09.780817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.780778    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j6w46" podStartSLOduration=3.114318998 podStartE2EDuration="21.780766907s" totalImagesPullingTime="18.666447909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:09.780189693 +0000 UTC m=+22.804588162" watchObservedRunningTime="2026-07-24 01:30:09.780766907 +0000 UTC m=+22.805165384"
Jul 24 01:30:09.795851 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:09.795815    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k42kw" podStartSLOduration=3.181757621 podStartE2EDuration="21.795804146s" totalImagesPullingTime="18.614046525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:09.795490912 +0000 UTC m=+22.819889389" watchObservedRunningTime="2026-07-24 01:30:09.795804146 +0000 UTC m=+22.820202623"
Jul 24 01:30:10.650719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.650661    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 01:30:10.722736 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.722686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7" event={"ID":"08f5981d-7e0d-4185-915f-8d3194b8213a","Type":"ContainerStarted","Data":"e3ddc31a0fa177f1da6802cc2a6b2f9daee69fa332af3fc2abe03478cd45e504"}
Jul 24 01:30:10.725936 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.725900    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"8daacebf1dc2940897c1a937cde174f6a5028df52456bd000469d8d9202083f8"}
Jul 24 01:30:10.727622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.727585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qk8q4" event={"ID":"14ca72b7-b2ad-4b9f-977c-ef962cfb5367","Type":"ContainerStarted","Data":"67f86f79cf5189e8ea376ccca91a007cc0e2edbfe57549fdec0e511077208126"}
Jul 24 01:30:10.741579 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.741497    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qk8q4" podStartSLOduration=4.098232526 podStartE2EDuration="22.741483644s" totalImagesPullingTime="18.643251118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:10.741071648 +0000 UTC m=+23.765470136" watchObservedRunningTime="2026-07-24 01:30:10.741483644 +0000 UTC m=+23.765882124"
Jul 24 01:30:10.884323 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.884228    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:30:10.884822 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:10.884805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:30:11.465800 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.465668    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T01:30:10.650711481Z","UUID":"29c403bf-b81c-48d0-a213-244c753cd816","Handler":null,"Name":"","Endpoint":""}
Jul 24 01:30:11.467676 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.467642    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 01:30:11.467817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.467688    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 01:30:11.499247 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.499218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:11.499436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.499250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:11.499436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.499218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:11.499436 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:11.499360    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:11.499576 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:11.499432    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:11.499576 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:11.499522    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:11.730637 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.730378    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:30:11.731020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:11.730906    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-49pmx"
Jul 24 01:30:12.736597 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:12.736556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"0ed3dc3245de773873aa59deb990801816236c43c4beeecf890c3ac5c2a694c2"}
Jul 24 01:30:12.738727 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:12.738701    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7" event={"ID":"08f5981d-7e0d-4185-915f-8d3194b8213a","Type":"ContainerStarted","Data":"90252a538be2a5775c40dbe2199b6135d6a67ee9ca728aa6949d8e8e5c56a53a"}
Jul 24 01:30:12.757109 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:12.757056    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjwn7" podStartSLOduration=3.875877886 podStartE2EDuration="24.757038811s" totalImagesPullingTime="20.881160925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:12.755854423 +0000 UTC m=+25.780252899" watchObservedRunningTime="2026-07-24 01:30:12.757038811 +0000 UTC m=+25.781437289"
Jul 24 01:30:13.499222 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:13.499193    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:13.499414 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:13.499190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:13.499414 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:13.499314    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:13.499414 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:13.499191    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:13.499414 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:13.499403    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:13.499571 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:13.499450    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:14.747303 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:14.747079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" event={"ID":"8679a38d-cda4-48f4-a5f2-96f8abda6f62","Type":"ContainerStarted","Data":"2ea45511a7859f90b03252bf2281a1d47e9ab1c1350b73ca1910f169996dd8e3"}
Jul 24 01:30:14.747962 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:14.747351    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:30:14.749225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:14.749197    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7771e29-58a0-4ab6-b60a-635763575225" containerID="67467001bea38a30db3c78febcc09a770a9a4f47ea684aa1a3f98a2cf9c3b255" exitCode=0
Jul 24 01:30:14.749325 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:14.749240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerDied","Data":"67467001bea38a30db3c78febcc09a770a9a4f47ea684aa1a3f98a2cf9c3b255"}
Jul 24 01:30:14.762639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:14.762620    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:30:14.771969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:14.771930    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4" podStartSLOduration=8.079914765 podStartE2EDuration="26.771916658s" totalImagesPullingTime="18.692001893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:14.770366905 +0000 UTC m=+27.794765392" watchObservedRunningTime="2026-07-24 01:30:14.771916658 +0000 UTC m=+27.796315134"
Jul 24 01:30:15.500725 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:15.500032    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:15.500725 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:15.500160    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:15.500725 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:15.500589    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:15.500725 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:15.500679    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:15.501444 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:15.501295    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:15.501444 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:15.501407    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:15.751903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:15.751833    2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 01:30:15.752372 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:15.752217    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:30:15.767534 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:15.767511    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:30:16.235169 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.234932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h2n47"]
Jul 24 01:30:16.235380 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.235283    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:16.235433 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:16.235400    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:16.237890 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.237863    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qj6hm"]
Jul 24 01:30:16.238027 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.237964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:16.238096 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:16.238051    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:16.238521 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.238498    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2b5xp"]
Jul 24 01:30:16.238597 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.238578    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:16.238688 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:16.238666    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:16.756200 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.756142    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7771e29-58a0-4ab6-b60a-635763575225" containerID="7c9c73b5afd58d946d95febd598aa77b5257f49364a944265ed471edb974944f" exitCode=0
Jul 24 01:30:16.756768 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.756226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerDied","Data":"7c9c73b5afd58d946d95febd598aa77b5257f49364a944265ed471edb974944f"}
Jul 24 01:30:16.756768 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:16.756360    2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 01:30:17.045148 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:17.045069    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:30:17.500813 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:17.500782    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:17.500966 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:17.500916    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:18.404228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.404192    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:18.485304 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.485271    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:18.499267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.499245    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:18.499351 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.499271    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:18.499392 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:18.499348    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:18.499467 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:18.499451    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:18.587199 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.587145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:18.762805 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.762737    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7771e29-58a0-4ab6-b60a-635763575225" containerID="946c888ee9773f125cf6fed11c3f9e9f65feb1080f406984a98d30b544ebe30a" exitCode=0
Jul 24 01:30:18.762922 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:18.762814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerDied","Data":"946c888ee9773f125cf6fed11c3f9e9f65feb1080f406984a98d30b544ebe30a"}
Jul 24 01:30:19.499722 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:19.499687    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:19.500328 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:19.499824    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:20.499298 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:20.499261    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:20.499471 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:20.499261    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:20.499471 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:20.499387    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h2n47" podUID="428c7226-3595-46d2-b65f-88b56844aa07"
Jul 24 01:30:20.499591 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:20.499485    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qj6hm" podUID="ee465a91-7a71-4825-b9af-38457c725db6"
Jul 24 01:30:21.070860 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.070826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:21.169847 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.169802    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:21.170746 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.170727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:21.170895 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.170878    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:30:21.170967 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.170948    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs podName:ee465a91-7a71-4825-b9af-38457c725db6 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.170929454 +0000 UTC m=+66.195327926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs") pod "network-metrics-daemon-qj6hm" (UID: "ee465a91-7a71-4825-b9af-38457c725db6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 01:30:21.271948 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.271913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:21.272217 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.272084    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 01:30:21.272217 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.272159    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret podName:428c7226-3595-46d2-b65f-88b56844aa07 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.272139278 +0000 UTC m=+66.296537739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret") pod "global-pull-secret-syncer-h2n47" (UID: "428c7226-3595-46d2-b65f-88b56844aa07") : object "kube-system"/"original-pull-secret" not registered
Jul 24 01:30:21.372631 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.372548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:21.372795 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.372741    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 01:30:21.372795 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.372765    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 01:30:21.372795 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.372777    2568 projected.go:196] Error preparing data for projected volume kube-api-access-skc2q for pod openshift-network-diagnostics/network-check-target-2b5xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:30:21.372943 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.372844    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q podName:80aef434-34a4-4586-b207-0ce8956ac5b7 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.372825003 +0000 UTC m=+66.397223481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-skc2q" (UniqueName: "kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q") pod "network-check-target-2b5xp" (UID: "80aef434-34a4-4586-b207-0ce8956ac5b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 01:30:21.499506 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.499472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:21.499678 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:21.499606    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2b5xp" podUID="80aef434-34a4-4586-b207-0ce8956ac5b7"
Jul 24 01:30:21.792080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.791901    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeReady"
Jul 24 01:30:21.792285 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.792215    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 01:30:21.843417 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.843384    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g8htf"]
Jul 24 01:30:21.847667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.847505    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zfqjs"]
Jul 24 01:30:21.848868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.847966    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:21.851054 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.851017    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"]
Jul 24 01:30:21.851268 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.851244    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:21.853117 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853094    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 01:30:21.853240 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853155    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 01:30:21.853524 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853504    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"]
Jul 24 01:30:21.853621 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853588    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 01:30:21.853672 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853658    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 01:30:21.853721 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853656    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tfscd\""
Jul 24 01:30:21.853767 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853749    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:21.854047 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853902    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g8g76\""
Jul 24 01:30:21.854047 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.853946    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 01:30:21.856292 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.856276    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-754c8b665-87zsc"]
Jul 24 01:30:21.856416 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.856400    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:21.857323 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.857118    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 01:30:21.857439 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.857419    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 01:30:21.857512 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.857497    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 01:30:21.857582 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.857420    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dpmdf\""
Jul 24 01:30:21.857709 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.857690    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 01:30:21.859399 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.859376    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6fbcd9ccc5-75cjt"]
Jul 24 01:30:21.859532 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.859502    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.859949 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.859750    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 01:30:21.859949 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.859882    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5wlxt\""
Jul 24 01:30:21.859949 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.859907    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 01:30:21.861058 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.861039    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 01:30:21.861160 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.861064    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 01:30:21.861864 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.861843    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 01:30:21.862350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.862156    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 01:30:21.862350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.862276    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ld5t9\""
Jul 24 01:30:21.862534 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.862489    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 01:30:21.864365 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.864326    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g8htf"]
Jul 24 01:30:21.864365 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.864358    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zfqjs"]
Jul 24 01:30:21.864513 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.864439    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:21.865345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.865194    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"]
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.867712    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vgmz8\""
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.867845    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.867910    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.868090    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.868134    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.868384    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 01:30:21.868510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.868415    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 01:30:21.874361 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.874328    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 01:30:21.875286 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.875262    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-754c8b665-87zsc"]
Jul 24 01:30:21.883659 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.883635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"]
Jul 24 01:30:21.885685 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.884511    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fbcd9ccc5-75cjt"]
Jul 24 01:30:21.977027 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.976992    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09738bcf-a949-4759-8d47-3d72bc990fa8-config\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:21.977228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-stats-auth\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:21.977228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-default-certificate\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:21.977228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-registry-certificates\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977160    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/086f90e8-d9f1-4ddc-9576-11ba7d48dfe7-cert\") pod \"ingress-canary-g8htf\" (UID: \"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7\") " pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:21.977228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12afefeb-7545-4697-91e2-a0796251fcca-ca-trust-extracted\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-tmp-dir\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:21.977488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977272    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-installation-pull-secrets\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5nx\" (UniqueName: \"kubernetes.io/projected/09738bcf-a949-4759-8d47-3d72bc990fa8-kube-api-access-pt5nx\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:21.977488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977378    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7dqp\" (UniqueName: \"kubernetes.io/projected/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-kube-api-access-l7dqp\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:21.977488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977415    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh5vc\" (UniqueName: \"kubernetes.io/projected/086f90e8-d9f1-4ddc-9576-11ba7d48dfe7-kube-api-access-jh5vc\") pod \"ingress-canary-g8htf\" (UID: \"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7\") " pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:21.977488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:21.977488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-bound-sa-token\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-trusted-ca\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-config-volume\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnc7s\" (UniqueName: \"kubernetes.io/projected/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-kube-api-access-bnc7s\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977691    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:21.977738 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-image-registry-private-configuration\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:21.977969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977803    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09738bcf-a949-4759-8d47-3d72bc990fa8-serving-cert\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:21.977969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:21.977969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlt5\" (UniqueName: \"kubernetes.io/projected/0690d3c9-be0d-472a-a17a-7344fdfab5fa-kube-api-access-dxlt5\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:21.977969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:21.977878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9cdb\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-kube-api-access-d9cdb\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.031295 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.031258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:22.078230 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078195    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5nx\" (UniqueName: \"kubernetes.io/projected/09738bcf-a949-4759-8d47-3d72bc990fa8-kube-api-access-pt5nx\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.078230 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7dqp\" (UniqueName: \"kubernetes.io/projected/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-kube-api-access-l7dqp\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh5vc\" (UniqueName: \"kubernetes.io/projected/086f90e8-d9f1-4ddc-9576-11ba7d48dfe7-kube-api-access-jh5vc\") pod \"ingress-canary-g8htf\" (UID: \"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7\") " pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078329    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-bound-sa-token\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-trusted-ca\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-config-volume\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnc7s\" (UniqueName: \"kubernetes.io/projected/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-kube-api-access-bnc7s\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-image-registry-private-configuration\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09738bcf-a949-4759-8d47-3d72bc990fa8-serving-cert\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.078618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.078702    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.078768    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:22.578750571 +0000 UTC m=+35.603149031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : secret "router-metrics-certs-default" not found
Jul 24 01:30:22.078807 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.078797    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.078866    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls podName:9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:22.578848139 +0000 UTC m=+35.603246600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mh6j2" (UID: "9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0") : secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.078932    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.078967    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls podName:1f5c33ef-bd68-46ed-a7f0-018ce8d680ba nodeName:}" failed. No retries permitted until 2026-07-24 01:30:22.578954817 +0000 UTC m=+35.603353276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls") pod "dns-default-zfqjs" (UID: "1f5c33ef-bd68-46ed-a7f0-018ce8d680ba") : secret "dns-default-metrics-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079083    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-config-volume\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.079254    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:22.579240447 +0000 UTC m=+35.603638920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : configmap references non-existent config key: service-ca.crt
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.079388    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.079409    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-754c8b665-87zsc: secret "image-registry-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.079455    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls podName:12afefeb-7545-4697-91e2-a0796251fcca nodeName:}" failed. No retries permitted until 2026-07-24 01:30:22.579440103 +0000 UTC m=+35.603838564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls") pod "image-registry-754c8b665-87zsc" (UID: "12afefeb-7545-4697-91e2-a0796251fcca") : secret "image-registry-tls" not found
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlt5\" (UniqueName: \"kubernetes.io/projected/0690d3c9-be0d-472a-a17a-7344fdfab5fa-kube-api-access-dxlt5\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9cdb\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-kube-api-access-d9cdb\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.079550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09738bcf-a949-4759-8d47-3d72bc990fa8-config\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-stats-auth\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-default-certificate\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.079956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-trusted-ca\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-registry-certificates\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/086f90e8-d9f1-4ddc-9576-11ba7d48dfe7-cert\") pod \"ingress-canary-g8htf\" (UID: \"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7\") " pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12afefeb-7545-4697-91e2-a0796251fcca-ca-trust-extracted\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-tmp-dir\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-installation-pull-secrets\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.080166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09738bcf-a949-4759-8d47-3d72bc990fa8-config\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.080676 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-tmp-dir\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.080743 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080721    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12afefeb-7545-4697-91e2-a0796251fcca-ca-trust-extracted\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.080891 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.080807    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-registry-certificates\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.083894 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.083859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:22.084667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.084492    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09738bcf-a949-4759-8d47-3d72bc990fa8-serving-cert\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.084667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.084617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-image-registry-private-configuration\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.084813 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.084689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-stats-auth\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.084813 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.084689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/086f90e8-d9f1-4ddc-9576-11ba7d48dfe7-cert\") pod \"ingress-canary-g8htf\" (UID: \"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7\") " pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:22.085090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.085035    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-default-certificate\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.085347 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.085317    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-installation-pull-secrets\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.089976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.089940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnc7s\" (UniqueName: \"kubernetes.io/projected/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-kube-api-access-bnc7s\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.090355 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.090308    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh5vc\" (UniqueName: \"kubernetes.io/projected/086f90e8-d9f1-4ddc-9576-11ba7d48dfe7-kube-api-access-jh5vc\") pod \"ingress-canary-g8htf\" (UID: \"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7\") " pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:22.090710 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.090676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7dqp\" (UniqueName: \"kubernetes.io/projected/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-kube-api-access-l7dqp\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:22.091104 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.091064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5nx\" (UniqueName: \"kubernetes.io/projected/09738bcf-a949-4759-8d47-3d72bc990fa8-kube-api-access-pt5nx\") pod \"service-ca-operator-5d6c75f84f-swkls\" (UID: \"09738bcf-a949-4759-8d47-3d72bc990fa8\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.091250 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.091232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9cdb\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-kube-api-access-d9cdb\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.091379 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.091351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-bound-sa-token\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.092288 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.092266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlt5\" (UniqueName: \"kubernetes.io/projected/0690d3c9-be0d-472a-a17a-7344fdfab5fa-kube-api-access-dxlt5\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.161603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.161547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g8htf"
Jul 24 01:30:22.181300 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.181263    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"
Jul 24 01:30:22.419942 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.419852    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:22.499459 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.499425    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:22.499648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.499625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:22.502228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.502157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 01:30:22.502350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.502237    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 01:30:22.502350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.502235    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pnzwr\""
Jul 24 01:30:22.520792 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.520772    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:22.584952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.584918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:22.585142 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.584975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.585142 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.585075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:22.585142 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585096    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 01:30:22.585142 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.585108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:22.585142 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:22.585141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585115    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-754c8b665-87zsc: secret "image-registry-tls" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585192    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585230    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:23.585209206 +0000 UTC m=+36.609607685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : configmap references non-existent config key: service-ca.crt
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585250    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585260    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls podName:12afefeb-7545-4697-91e2-a0796251fcca nodeName:}" failed. No retries permitted until 2026-07-24 01:30:23.585241298 +0000 UTC m=+36.609639766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls") pod "image-registry-754c8b665-87zsc" (UID: "12afefeb-7545-4697-91e2-a0796251fcca") : secret "image-registry-tls" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585279    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:23.585269538 +0000 UTC m=+36.609668007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : secret "router-metrics-certs-default" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585281    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585321    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls podName:1f5c33ef-bd68-46ed-a7f0-018ce8d680ba nodeName:}" failed. No retries permitted until 2026-07-24 01:30:23.585309851 +0000 UTC m=+36.609708308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls") pod "dns-default-zfqjs" (UID: "1f5c33ef-bd68-46ed-a7f0-018ce8d680ba") : secret "dns-default-metrics-tls" not found
Jul 24 01:30:22.585416 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:22.585343    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls podName:9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:23.585327277 +0000 UTC m=+36.609725738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mh6j2" (UID: "9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0") : secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:23.308292 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.308264    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g8htf"]
Jul 24 01:30:23.312435 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:23.312406    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086f90e8_d9f1_4ddc_9576_11ba7d48dfe7.slice/crio-46cebd1ebfb60a19328834cacecc366b0d0ff29364040f91cda77e70ded67f46 WatchSource:0}: Error finding container 46cebd1ebfb60a19328834cacecc366b0d0ff29364040f91cda77e70ded67f46: Status 404 returned error can't find the container with id 46cebd1ebfb60a19328834cacecc366b0d0ff29364040f91cda77e70ded67f46
Jul 24 01:30:23.314579 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.314546    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls"]
Jul 24 01:30:23.319078 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:23.319057    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09738bcf_a949_4759_8d47_3d72bc990fa8.slice/crio-2a4b926dbb7265fc79dba0030aea3c232698d72cc67f73b74e5f59ee9e29398d WatchSource:0}: Error finding container 2a4b926dbb7265fc79dba0030aea3c232698d72cc67f73b74e5f59ee9e29398d: Status 404 returned error can't find the container with id 2a4b926dbb7265fc79dba0030aea3c232698d72cc67f73b74e5f59ee9e29398d
Jul 24 01:30:23.499271 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.499089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:23.501959 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.501929    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 01:30:23.502161 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.502140    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 01:30:23.503739 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.502844    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c62r2\""
Jul 24 01:30:23.594590 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.594559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:23.594590 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.594595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.594617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.594635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.594659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594719    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594736    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594759    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:25.594737426 +0000 UTC m=+38.619135884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : configmap references non-existent config key: service-ca.crt
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594762    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594783    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-754c8b665-87zsc: secret "image-registry-tls" not found
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594789    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:25.594774224 +0000 UTC m=+38.619172680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : secret "router-metrics-certs-default" not found
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594807    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls podName:1f5c33ef-bd68-46ed-a7f0-018ce8d680ba nodeName:}" failed. No retries permitted until 2026-07-24 01:30:25.59479794 +0000 UTC m=+38.619196407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls") pod "dns-default-zfqjs" (UID: "1f5c33ef-bd68-46ed-a7f0-018ce8d680ba") : secret "dns-default-metrics-tls" not found
Jul 24 01:30:23.594817 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594821    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls podName:12afefeb-7545-4697-91e2-a0796251fcca nodeName:}" failed. No retries permitted until 2026-07-24 01:30:25.594813566 +0000 UTC m=+38.619212022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls") pod "image-registry-754c8b665-87zsc" (UID: "12afefeb-7545-4697-91e2-a0796251fcca") : secret "image-registry-tls" not found
Jul 24 01:30:23.595164 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594823    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:23.595164 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:23.594874    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls podName:9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:25.594865907 +0000 UTC m=+38.619264365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mh6j2" (UID: "9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0") : secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:23.779652 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.779619    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7771e29-58a0-4ab6-b60a-635763575225" containerID="14239ce9334fb6c6918ca57440af657a8dbeb629ef9b7869385cfba41256955d" exitCode=0
Jul 24 01:30:23.779830 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.779663    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerDied","Data":"14239ce9334fb6c6918ca57440af657a8dbeb629ef9b7869385cfba41256955d"}
Jul 24 01:30:23.781091 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.781047    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls" event={"ID":"09738bcf-a949-4759-8d47-3d72bc990fa8","Type":"ContainerStarted","Data":"2a4b926dbb7265fc79dba0030aea3c232698d72cc67f73b74e5f59ee9e29398d"}
Jul 24 01:30:23.782305 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:23.782273    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g8htf" event={"ID":"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7","Type":"ContainerStarted","Data":"46cebd1ebfb60a19328834cacecc366b0d0ff29364040f91cda77e70ded67f46"}
Jul 24 01:30:24.790651 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:24.790515    2568 generic.go:356] "Generic (PLEG): container finished" podID="e7771e29-58a0-4ab6-b60a-635763575225" containerID="887b9403e6894ceff74012e86b2ede01eaf65d17aa621142e935355d89942c9a" exitCode=0
Jul 24 01:30:24.791258 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:24.791164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerDied","Data":"887b9403e6894ceff74012e86b2ede01eaf65d17aa621142e935355d89942c9a"}
Jul 24 01:30:25.610925 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:25.610896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:25.611092 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:25.610941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:25.611092 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:25.610968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:25.611092 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:25.610993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:25.611092 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:25.611030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:25.611092 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611056    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 01:30:25.611092 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611074    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:29.611055419 +0000 UTC m=+42.635453884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : configmap references non-existent config key: service-ca.crt
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611119    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls podName:1f5c33ef-bd68-46ed-a7f0-018ce8d680ba nodeName:}" failed. No retries permitted until 2026-07-24 01:30:29.611100384 +0000 UTC m=+42.635498859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls") pod "dns-default-zfqjs" (UID: "1f5c33ef-bd68-46ed-a7f0-018ce8d680ba") : secret "dns-default-metrics-tls" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611127    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611135    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611141    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-754c8b665-87zsc: secret "image-registry-tls" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611201    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls podName:9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:29.611170953 +0000 UTC m=+42.635569408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mh6j2" (UID: "9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0") : secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611231    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls podName:12afefeb-7545-4697-91e2-a0796251fcca nodeName:}" failed. No retries permitted until 2026-07-24 01:30:29.611219709 +0000 UTC m=+42.635618186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls") pod "image-registry-754c8b665-87zsc" (UID: "12afefeb-7545-4697-91e2-a0796251fcca") : secret "image-registry-tls" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611233    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 01:30:25.611396 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:25.611297    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:29.61128193 +0000 UTC m=+42.635680391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : secret "router-metrics-certs-default" not found
Jul 24 01:30:26.353622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.353539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:26.429160 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.429131    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:26.799783 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.799747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28zrg" event={"ID":"e7771e29-58a0-4ab6-b60a-635763575225","Type":"ContainerStarted","Data":"7d068cb68a69dda99f79a1261b00ca1a94e417f005bc52f692acb9f6ada5da93"}
Jul 24 01:30:26.801152 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.801124    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls" event={"ID":"09738bcf-a949-4759-8d47-3d72bc990fa8","Type":"ContainerStarted","Data":"d56f4661985357b6aec5ad8ad121c1249ec416cadbb9d63536b81b09672a520c"}
Jul 24 01:30:26.802562 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.802544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g8htf" event={"ID":"086f90e8-d9f1-4ddc-9576-11ba7d48dfe7","Type":"ContainerStarted","Data":"748b11518428881596a63149c1dd6bdd06651dc0e1d00c979a67d856f133a71c"}
Jul 24 01:30:26.825159 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.825111    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-28zrg" podStartSLOduration=8.996682021 podStartE2EDuration="38.825095586s" totalImagesPullingTime="29.828413565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:26.823552629 +0000 UTC m=+39.847951106" watchObservedRunningTime="2026-07-24 01:30:26.825095586 +0000 UTC m=+39.849494064"
Jul 24 01:30:26.841212 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.841150    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls" podStartSLOduration=2.739980263 podStartE2EDuration="5.841136458s" totalImagesPullingTime="3.101156195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:26.840307103 +0000 UTC m=+39.864705579" watchObservedRunningTime="2026-07-24 01:30:26.841136458 +0000 UTC m=+39.865534935"
Jul 24 01:30:26.855239 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.855194    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g8htf" podStartSLOduration=2.753487674 podStartE2EDuration="5.855159155s" totalImagesPullingTime="3.101671481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:26.854133392 +0000 UTC m=+39.878531869" watchObservedRunningTime="2026-07-24 01:30:26.855159155 +0000 UTC m=+39.879557612"
Jul 24 01:30:26.957630 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:26.957592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:27.008755 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:27.008718    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:27.718746 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:27.718714    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:27.816644 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:27.816613    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:28.434975 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:28.434943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:28.533770 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:28.533723    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:29.007939 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.007900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:29.109525 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.109494    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:29.208503 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.208470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:29.586673 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.586639    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j2krt"]
Jul 24 01:30:29.609101 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.609071    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:29.619284 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.619259    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2krt"]
Jul 24 01:30:29.619411 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.619290    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.621625 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.621605    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 01:30:29.621763 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.621606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 01:30:29.621763 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.621606    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 01:30:29.622585 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.622566    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 01:30:29.622681 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.622609    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pds6h\""
Jul 24 01:30:29.646329 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-crio-socket\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.646450 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646371    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:29.646450 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czwxm\" (UniqueName: \"kubernetes.io/projected/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-api-access-czwxm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.646450 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:29.646556 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.646556 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.646556 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:29.646556 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646508    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 01:30:29.646556 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646561    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646588    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls podName:1f5c33ef-bd68-46ed-a7f0-018ce8d680ba nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.646573647 +0000 UTC m=+50.670972106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls") pod "dns-default-zfqjs" (UID: "1f5c33ef-bd68-46ed-a7f0-018ce8d680ba") : secret "dns-default-metrics-tls" not found
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646654    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646673    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-754c8b665-87zsc: secret "image-registry-tls" not found
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646660    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.646639184 +0000 UTC m=+50.671037653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : configmap references non-existent config key: service-ca.crt
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646726    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 01:30:29.646752 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646748    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls podName:9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.646727228 +0000 UTC m=+50.671125701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mh6j2" (UID: "9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0") : secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:29.647020 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646772    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls podName:12afefeb-7545-4697-91e2-a0796251fcca nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.646761327 +0000 UTC m=+50.671159787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls") pod "image-registry-754c8b665-87zsc" (UID: "12afefeb-7545-4697-91e2-a0796251fcca") : secret "image-registry-tls" not found
Jul 24 01:30:29.647020 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.646795    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.646786882 +0000 UTC m=+50.671185351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : secret "router-metrics-certs-default" not found
Jul 24 01:30:29.647020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.646845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-data-volume\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.664829 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.664788    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:29.747745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.747708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czwxm\" (UniqueName: \"kubernetes.io/projected/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-api-access-czwxm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.747745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.747751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.747938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.747767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.747938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.747837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-data-volume\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.747938 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.747844    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 01:30:29.747938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.747868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-crio-socket\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.747938 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.747904    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:30.247886771 +0000 UTC m=+43.272285241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : configmap "kube-rbac-proxy" not found
Jul 24 01:30:29.747938 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.747933    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:29.748223 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:29.747978    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:30.247965164 +0000 UTC m=+43.272363619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:29.748223 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.748057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-crio-socket\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.748290 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.748224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-data-volume\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:29.758972 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:29.758946    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czwxm\" (UniqueName: \"kubernetes.io/projected/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-api-access-czwxm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:30.061977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.061944    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:30.115679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.115647    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:30.252651 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.252610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:30.252651 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.252651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:30.252943 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:30.252754    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:30.252943 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:30.252800    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 01:30:30.252943 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:30.252804    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:31.252790966 +0000 UTC m=+44.277189420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:30.252943 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:30.252922    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:31.252908041 +0000 UTC m=+44.277306496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : configmap "kube-rbac-proxy" not found
Jul 24 01:30:30.399624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.399528    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:30.458524 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.458491    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:30.936892 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:30.936856    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:31.260226 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:31.260160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:31.260226 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:31.260225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:31.260702 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:31.260316    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 01:30:31.260702 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:31.260340    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:31.260702 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:31.260392    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:33.260377765 +0000 UTC m=+46.284776220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:31.260702 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:31.260406    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:33.260399041 +0000 UTC m=+46.284797496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : configmap "kube-rbac-proxy" not found
Jul 24 01:30:31.729563 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:31.729532    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:31.793017 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:31.792977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:32.568156 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:32.568130    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvrxj_d1908820-260b-4a3a-87b6-7aaff7be860c/dns-node-resolver/0.log"
Jul 24 01:30:33.274905 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:33.274871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:33.274905 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:33.274905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:33.275111 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:33.275002    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 01:30:33.275111 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:33.275046    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:33.275111 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:33.275072    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.275055182 +0000 UTC m=+50.299453637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : configmap "kube-rbac-proxy" not found
Jul 24 01:30:33.275111 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:33.275086    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:37.275080716 +0000 UTC m=+50.299479171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:33.367992 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:33.367965    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4k6tm_a23066aa-0fd2-4fef-96e5-8c71348c2999/node-ca/0.log"
Jul 24 01:30:33.508087 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:33.508058    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:33.968659 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:33.968613    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g8htf_086f90e8-d9f1-4ddc-9576-11ba7d48dfe7/serve-healthcheck-canary/0.log"
Jul 24 01:30:34.287839 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:34.287763    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:34.947544 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:34.947508    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:35.068635 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:35.068603    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:35.169332 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:35.169302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:35.269804 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:35.269725    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:35.333472 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:35.333443    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:36.044111 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:36.044077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:36.443466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:36.443434    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:36.639943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:36.639914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:37.043162 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.043128    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:37.305233 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.305128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:37.305233 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.305165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:37.305452 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.305394    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:37.305452 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.305445    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls podName:be0aeed2-b8f1-4ac1-9a3b-acf786c0d792 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:45.30543203 +0000 UTC m=+58.329830484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2krt" (UID: "be0aeed2-b8f1-4ac1-9a3b-acf786c0d792") : secret "insights-runtime-extractor-tls" not found
Jul 24 01:30:37.305733 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.305709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:37.644127 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.644040    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:37.707313 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.707278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:37.707481 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.707323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:37.707481 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.707349    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") pod \"image-registry-754c8b665-87zsc\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") " pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:37.707481 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707430    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:37.707481 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707465    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.707444153 +0000 UTC m=+66.731842621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : configmap references non-existent config key: service-ca.crt
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707431    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.707500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707511    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-754c8b665-87zsc: secret "image-registry-tls" not found
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707549    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls podName:12afefeb-7545-4697-91e2-a0796251fcca nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.707534767 +0000 UTC m=+66.731933227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls") pod "image-registry-754c8b665-87zsc" (UID: "12afefeb-7545-4697-91e2-a0796251fcca") : secret "image-registry-tls" not found
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707569    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls podName:9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0 nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.707562868 +0000 UTC m=+66.731961322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mh6j2" (UID: "9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0") : secret "cluster-monitoring-operator-tls" not found
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707577    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:37.707606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707626    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs podName:0690d3c9-be0d-472a-a17a-7344fdfab5fa nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.70761261 +0000 UTC m=+66.732011065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs") pod "router-default-6fbcd9ccc5-75cjt" (UID: "0690d3c9-be0d-472a-a17a-7344fdfab5fa") : secret "router-metrics-certs-default" not found
Jul 24 01:30:37.707661 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707654    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 01:30:37.707946 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:37.707675    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls podName:1f5c33ef-bd68-46ed-a7f0-018ce8d680ba nodeName:}" failed. No retries permitted until 2026-07-24 01:30:53.707669153 +0000 UTC m=+66.732067607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls") pod "dns-default-zfqjs" (UID: "1f5c33ef-bd68-46ed-a7f0-018ce8d680ba") : secret "dns-default-metrics-tls" not found
Jul 24 01:30:38.246516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:38.246482    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:38.442656 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:38.442620    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:38.639563 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:38.639479    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:38.693455 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:38.693425    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:38.973760 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:38.973728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:39.074672 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:39.074636    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:39.641675 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:39.641640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:39.742165 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:39.742124    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:40.052515 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:40.052480    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:40.244630 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:40.244592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:40.847477 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:40.847444    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:41.254848 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:41.254800    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:41.441643 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:41.441607    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:41.647083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:41.646988    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:41.851277 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:41.851250    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:41.951464 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:41.951436    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:42.244956 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:42.244867    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:42.844963 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:42.844932    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:43.443883 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:43.443844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:43.645843 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:43.645815    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:44.050095 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:44.050041    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:44.243852 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:44.243785    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:44.444865 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:44.444844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:45.245658 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.245626    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:45.368277 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.368238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:45.370534 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.370510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be0aeed2-b8f1-4ac1-9a3b-acf786c0d792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2krt\" (UID: \"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792\") " pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:45.447140 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.447097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:45.528658 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.528577    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2krt"
Jul 24 01:30:45.650401 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.650368    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:45.653630 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.653604    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2krt"]
Jul 24 01:30:45.656835 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:45.656808    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0aeed2_b8f1_4ac1_9a3b_acf786c0d792.slice/crio-dfd53d533ad17eec524851d25f3a403279a41f8c8ce6eaf4cbcac35347531129 WatchSource:0}: Error finding container dfd53d533ad17eec524851d25f3a403279a41f8c8ce6eaf4cbcac35347531129: Status 404 returned error can't find the container with id dfd53d533ad17eec524851d25f3a403279a41f8c8ce6eaf4cbcac35347531129
Jul 24 01:30:45.845658 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:45.845577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2krt" event={"ID":"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792","Type":"ContainerStarted","Data":"dfd53d533ad17eec524851d25f3a403279a41f8c8ce6eaf4cbcac35347531129"}
Jul 24 01:30:46.531356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:46.531314    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:46.632823 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:46.632787    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:46.690491 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:46.690456    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:46.825572 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:46.825484    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:47.013875 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:47.013826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:47.079514 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:47.079413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:47.422236 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:47.422136    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:47.473912 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:47.473881    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:47.834838 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:47.834803    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:47.886737 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:47.886709    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:48.026289 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:48.026255    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:48.216682 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:48.216648    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:48.390774 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:48.390742    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:48.443425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:48.443394    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:48.626584 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:48.626481    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:48.774460 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:48.774423    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4tm4"
Jul 24 01:30:50.462664 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.462630    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-754c8b665-87zsc"]
Jul 24 01:30:50.463103 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:30:50.462882    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-754c8b665-87zsc" podUID="12afefeb-7545-4697-91e2-a0796251fcca"
Jul 24 01:30:50.477274 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.477246    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c6c967c67-6zgj9"]
Jul 24 01:30:50.479326 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.479290    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.493039 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.493011    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6c967c67-6zgj9"]
Jul 24 01:30:50.557774 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.557744    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-vd9fr"]
Jul 24 01:30:50.559407 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.559388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:30:50.561733 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.561707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:50.562603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.562580    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 01:30:50.563220 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.563202    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 01:30:50.565389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.565347    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6zr4l\""
Jul 24 01:30:50.585427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.585408    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-vd9fr"]
Jul 24 01:30:50.612669 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.612642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a4eb457-a2e7-4391-84cc-943313cb240d-image-registry-private-configuration\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.612999 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.612794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk6jf\" (UniqueName: \"kubernetes.io/projected/f80dd9d7-7bda-42f7-9145-7655e00c586f-kube-api-access-sk6jf\") pod \"downloads-7c97dc4555-vd9fr\" (UID: \"f80dd9d7-7bda-42f7-9145-7655e00c586f\") " pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:30:50.612999 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.612826    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a4eb457-a2e7-4391-84cc-943313cb240d-registry-certificates\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.612999 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.612857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a4eb457-a2e7-4391-84cc-943313cb240d-trusted-ca\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.613262 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.613235    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-registry-tls\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.613383 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.613288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-bound-sa-token\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.613383 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.613328    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a4eb457-a2e7-4391-84cc-943313cb240d-ca-trust-extracted\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.613383 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.613344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a4eb457-a2e7-4391-84cc-943313cb240d-installation-pull-secrets\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.613383 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.613371    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ht7j\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-kube-api-access-6ht7j\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.661191 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.661146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:50.714576 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a4eb457-a2e7-4391-84cc-943313cb240d-image-registry-private-configuration\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.714740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk6jf\" (UniqueName: \"kubernetes.io/projected/f80dd9d7-7bda-42f7-9145-7655e00c586f-kube-api-access-sk6jf\") pod \"downloads-7c97dc4555-vd9fr\" (UID: \"f80dd9d7-7bda-42f7-9145-7655e00c586f\") " pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:30:50.714740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a4eb457-a2e7-4391-84cc-943313cb240d-registry-certificates\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.714740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a4eb457-a2e7-4391-84cc-943313cb240d-trusted-ca\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.714740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-registry-tls\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.714740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-bound-sa-token\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.715007 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a4eb457-a2e7-4391-84cc-943313cb240d-ca-trust-extracted\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.715007 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a4eb457-a2e7-4391-84cc-943313cb240d-installation-pull-secrets\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.715007 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.714839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ht7j\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-kube-api-access-6ht7j\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.715235 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.715203    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a4eb457-a2e7-4391-84cc-943313cb240d-ca-trust-extracted\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.715533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.715512    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a4eb457-a2e7-4391-84cc-943313cb240d-registry-certificates\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.715902 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.715883    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a4eb457-a2e7-4391-84cc-943313cb240d-trusted-ca\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.717067 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.717048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a4eb457-a2e7-4391-84cc-943313cb240d-image-registry-private-configuration\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.717172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.717072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a4eb457-a2e7-4391-84cc-943313cb240d-installation-pull-secrets\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.717262 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.717223    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-registry-tls\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.723520 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.723491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ht7j\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-kube-api-access-6ht7j\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.723663 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.723641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a4eb457-a2e7-4391-84cc-943313cb240d-bound-sa-token\") pod \"image-registry-7c6c967c67-6zgj9\" (UID: \"2a4eb457-a2e7-4391-84cc-943313cb240d\") " pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.723711 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.723693    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk6jf\" (UniqueName: \"kubernetes.io/projected/f80dd9d7-7bda-42f7-9145-7655e00c586f-kube-api-access-sk6jf\") pod \"downloads-7c97dc4555-vd9fr\" (UID: \"f80dd9d7-7bda-42f7-9145-7655e00c586f\") " pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:30:50.759624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.759592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:50.792943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.792914    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ld5t9\""
Jul 24 01:30:50.800857 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.800819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:50.861741 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.861699    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:50.861903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.861783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2krt" event={"ID":"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792","Type":"ContainerStarted","Data":"a0543476c40505bd94eaea4dd4a419cc89b1ddda4d63f5182b1457a7c8dccbc9"}
Jul 24 01:30:50.867130 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.867108    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:50.868391 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.868372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:30:50.915765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915722    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-trusted-ca\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.915938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915806    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-bound-sa-token\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.915938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915846    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12afefeb-7545-4697-91e2-a0796251fcca-ca-trust-extracted\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.915938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915890    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-installation-pull-secrets\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.915938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9cdb\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-kube-api-access-d9cdb\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.916550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915964    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-registry-certificates\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.916550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.915990    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-image-registry-private-configuration\") pod \"12afefeb-7545-4697-91e2-a0796251fcca\" (UID: \"12afefeb-7545-4697-91e2-a0796251fcca\") "
Jul 24 01:30:50.916719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.916694    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:30:50.916977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.916924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:30:50.917306 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.917258    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12afefeb-7545-4697-91e2-a0796251fcca-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:30:50.919228 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.919152    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:30:50.919320 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.919249    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:30:50.919571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.919534    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-kube-api-access-d9cdb" (OuterVolumeSpecName: "kube-api-access-d9cdb") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "kube-api-access-d9cdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:30:50.919949 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.919914    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "12afefeb-7545-4697-91e2-a0796251fcca" (UID: "12afefeb-7545-4697-91e2-a0796251fcca"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:30:50.933405 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.932909    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6c967c67-6zgj9"]
Jul 24 01:30:50.996413 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:50.996386    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-vd9fr"]
Jul 24 01:30:50.999030 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:50.999003    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80dd9d7_7bda_42f7_9145_7655e00c586f.slice/crio-e54f6faf3958bb592bdac472fbd51cb49e2f4bdbeeead489d01f9307764cf87a WatchSource:0}: Error finding container e54f6faf3958bb592bdac472fbd51cb49e2f4bdbeeead489d01f9307764cf87a: Status 404 returned error can't find the container with id e54f6faf3958bb592bdac472fbd51cb49e2f4bdbeeead489d01f9307764cf87a
Jul 24 01:30:51.016706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016681    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-registry-certificates\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.016706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016704    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-image-registry-private-configuration\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.016825 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016713    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12afefeb-7545-4697-91e2-a0796251fcca-trusted-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.016825 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016722    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-bound-sa-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.016825 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016732    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12afefeb-7545-4697-91e2-a0796251fcca-ca-trust-extracted\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.016825 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016740    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12afefeb-7545-4697-91e2-a0796251fcca-installation-pull-secrets\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.016825 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.016750    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9cdb\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-kube-api-access-d9cdb\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:51.867114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.866992    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-vd9fr" event={"ID":"f80dd9d7-7bda-42f7-9145-7655e00c586f","Type":"ContainerStarted","Data":"e54f6faf3958bb592bdac472fbd51cb49e2f4bdbeeead489d01f9307764cf87a"}
Jul 24 01:30:51.869354 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.869038    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-754c8b665-87zsc"
Jul 24 01:30:51.869354 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.869038    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9" event={"ID":"2a4eb457-a2e7-4391-84cc-943313cb240d","Type":"ContainerStarted","Data":"868ce13e0800c69a49a48a09954a74d3ac2642fe682b0715d9ca4de203d36252"}
Jul 24 01:30:51.869354 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.869194    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9" event={"ID":"2a4eb457-a2e7-4391-84cc-943313cb240d","Type":"ContainerStarted","Data":"ce1bd4e7dca67dd41616f0cdfdc0d881032a314168e09c82abf5e1dcb98b0050"}
Jul 24 01:30:51.869632 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.869466    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:30:51.894573 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.894091    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9" podStartSLOduration=1.8940722399999999 podStartE2EDuration="1.89407224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:51.892318615 +0000 UTC m=+64.916717093" watchObservedRunningTime="2026-07-24 01:30:51.89407224 +0000 UTC m=+64.918470719"
Jul 24 01:30:51.918425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.918395    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-754c8b665-87zsc"]
Jul 24 01:30:51.922639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:51.922612    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-754c8b665-87zsc"]
Jul 24 01:30:52.027212 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:52.027158    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12afefeb-7545-4697-91e2-a0796251fcca-registry-tls\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:30:52.346577 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:52.346520    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:52.446548 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:52.446508    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:52.501817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:52.501783    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:53.238291 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.238197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:53.240878 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.240855    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 01:30:53.251533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.251478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee465a91-7a71-4825-b9af-38457c725db6-metrics-certs\") pod \"network-metrics-daemon-qj6hm\" (UID: \"ee465a91-7a71-4825-b9af-38457c725db6\") " pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:53.338952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.338917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:53.341589 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.341565    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 01:30:53.351909 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.351882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/428c7226-3595-46d2-b65f-88b56844aa07-original-pull-secret\") pod \"global-pull-secret-syncer-h2n47\" (UID: \"428c7226-3595-46d2-b65f-88b56844aa07\") " pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:53.414193 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.414147    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pnzwr\""
Jul 24 01:30:53.416989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.416957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h2n47"
Jul 24 01:30:53.422071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.422050    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qj6hm"
Jul 24 01:30:53.440166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.440055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:53.442779 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.442753    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 01:30:53.453615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.453523    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 01:30:53.464324 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.464299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skc2q\" (UniqueName: \"kubernetes.io/projected/80aef434-34a4-4586-b207-0ce8956ac5b7-kube-api-access-skc2q\") pod \"network-check-target-2b5xp\" (UID: \"80aef434-34a4-4586-b207-0ce8956ac5b7\") " pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:53.504645 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.504477    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12afefeb-7545-4697-91e2-a0796251fcca" path="/var/lib/kubelet/pods/12afefeb-7545-4697-91e2-a0796251fcca/volumes"
Jul 24 01:30:53.512904 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.512877    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c62r2\""
Jul 24 01:30:53.521695 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.521668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:30:53.743451 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.743417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:53.743641 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.743475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:53.743641 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.743515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:53.743641 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.743541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:53.744309 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.744280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0690d3c9-be0d-472a-a17a-7344fdfab5fa-service-ca-bundle\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:53.746245 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.746222    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f5c33ef-bd68-46ed-a7f0-018ce8d680ba-metrics-tls\") pod \"dns-default-zfqjs\" (UID: \"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba\") " pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:53.746519 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.746494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mh6j2\" (UID: \"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:53.747229 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.747205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0690d3c9-be0d-472a-a17a-7344fdfab5fa-metrics-certs\") pod \"router-default-6fbcd9ccc5-75cjt\" (UID: \"0690d3c9-be0d-472a-a17a-7344fdfab5fa\") " pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:53.979068 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.979037    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g8g76\""
Jul 24 01:30:53.988044 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.987894    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:30:53.989999 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.989972    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5wlxt\""
Jul 24 01:30:53.998831 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:53.998806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"
Jul 24 01:30:54.003545 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:54.003522    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vgmz8\""
Jul 24 01:30:54.011260 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:54.011235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:55.131145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.129844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qj6hm"]
Jul 24 01:30:55.270316 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:55.270278    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee465a91_7a71_4825_b9af_38457c725db6.slice/crio-be4a3527fc0bca0bd5fbd645060ffc88ab53a17ac424e0750962c343fe015f38 WatchSource:0}: Error finding container be4a3527fc0bca0bd5fbd645060ffc88ab53a17ac424e0750962c343fe015f38: Status 404 returned error can't find the container with id be4a3527fc0bca0bd5fbd645060ffc88ab53a17ac424e0750962c343fe015f38
Jul 24 01:30:55.367007 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.364658    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fbcd9ccc5-75cjt"]
Jul 24 01:30:55.367007 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.366303    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h2n47"]
Jul 24 01:30:55.367628 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.367327    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2b5xp"]
Jul 24 01:30:55.368509 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.368491    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zfqjs"]
Jul 24 01:30:55.369372 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:55.369327    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aef434_34a4_4586_b207_0ce8956ac5b7.slice/crio-ef33ef2324ad39d05b66e64fd3d2b3f5326c6f8d55ac96263ba55c20c89ecd5a WatchSource:0}: Error finding container ef33ef2324ad39d05b66e64fd3d2b3f5326c6f8d55ac96263ba55c20c89ecd5a: Status 404 returned error can't find the container with id ef33ef2324ad39d05b66e64fd3d2b3f5326c6f8d55ac96263ba55c20c89ecd5a
Jul 24 01:30:55.369478 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.369384    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2"]
Jul 24 01:30:55.370485 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:55.370322    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0690d3c9_be0d_472a_a17a_7344fdfab5fa.slice/crio-d094bfb131d17a28e9ea0132f40c15d1cce85edad0ea17641e2d64c97f6526aa WatchSource:0}: Error finding container d094bfb131d17a28e9ea0132f40c15d1cce85edad0ea17641e2d64c97f6526aa: Status 404 returned error can't find the container with id d094bfb131d17a28e9ea0132f40c15d1cce85edad0ea17641e2d64c97f6526aa
Jul 24 01:30:55.371718 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:55.371692    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428c7226_3595_46d2_b65f_88b56844aa07.slice/crio-afb91920717c89123572226eb9f20faf7ba3ab3f2c6cbd062bf2ea9059cb82d9 WatchSource:0}: Error finding container afb91920717c89123572226eb9f20faf7ba3ab3f2c6cbd062bf2ea9059cb82d9: Status 404 returned error can't find the container with id afb91920717c89123572226eb9f20faf7ba3ab3f2c6cbd062bf2ea9059cb82d9
Jul 24 01:30:55.372799 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:55.372716    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b58c51c_66eb_4646_8a6b_3bf4e5ac91c0.slice/crio-8bd8d586ad334f81143617a210ca350ad84cab3b19e70e2a8717169c1c9a5579 WatchSource:0}: Error finding container 8bd8d586ad334f81143617a210ca350ad84cab3b19e70e2a8717169c1c9a5579: Status 404 returned error can't find the container with id 8bd8d586ad334f81143617a210ca350ad84cab3b19e70e2a8717169c1c9a5579
Jul 24 01:30:55.373419 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:30:55.373303    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5c33ef_bd68_46ed_a7f0_018ce8d680ba.slice/crio-1a0f87c463de8a1202f8b8a4443efe0f44d9c0d6ac24a9beb6e674d50ba0dca9 WatchSource:0}: Error finding container 1a0f87c463de8a1202f8b8a4443efe0f44d9c0d6ac24a9beb6e674d50ba0dca9: Status 404 returned error can't find the container with id 1a0f87c463de8a1202f8b8a4443efe0f44d9c0d6ac24a9beb6e674d50ba0dca9
Jul 24 01:30:55.415862 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.415839    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:55.516726 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.516668    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:55.883507 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.882722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt" event={"ID":"0690d3c9-be0d-472a-a17a-7344fdfab5fa","Type":"ContainerStarted","Data":"e9b02547604f8075f3d0f838548cc6e6c7067837c5dedf2099e3617d1563dcb9"}
Jul 24 01:30:55.883507 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.882780    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt" event={"ID":"0690d3c9-be0d-472a-a17a-7344fdfab5fa","Type":"ContainerStarted","Data":"d094bfb131d17a28e9ea0132f40c15d1cce85edad0ea17641e2d64c97f6526aa"}
Jul 24 01:30:55.884816 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.884784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h2n47" event={"ID":"428c7226-3595-46d2-b65f-88b56844aa07","Type":"ContainerStarted","Data":"afb91920717c89123572226eb9f20faf7ba3ab3f2c6cbd062bf2ea9059cb82d9"}
Jul 24 01:30:55.886888 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.886860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2krt" event={"ID":"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792","Type":"ContainerStarted","Data":"03f14cf6af1b0b57b905cc9c6a089c2549adac7debf620c7426829f0c5920d42"}
Jul 24 01:30:55.888533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.888483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2b5xp" event={"ID":"80aef434-34a4-4586-b207-0ce8956ac5b7","Type":"ContainerStarted","Data":"ef33ef2324ad39d05b66e64fd3d2b3f5326c6f8d55ac96263ba55c20c89ecd5a"}
Jul 24 01:30:55.890594 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.890569    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2" event={"ID":"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0","Type":"ContainerStarted","Data":"8bd8d586ad334f81143617a210ca350ad84cab3b19e70e2a8717169c1c9a5579"}
Jul 24 01:30:55.891880 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.891805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zfqjs" event={"ID":"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba","Type":"ContainerStarted","Data":"1a0f87c463de8a1202f8b8a4443efe0f44d9c0d6ac24a9beb6e674d50ba0dca9"}
Jul 24 01:30:55.893422 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:55.893346    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qj6hm" event={"ID":"ee465a91-7a71-4825-b9af-38457c725db6","Type":"ContainerStarted","Data":"be4a3527fc0bca0bd5fbd645060ffc88ab53a17ac424e0750962c343fe015f38"}
Jul 24 01:30:56.012242 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:56.012139    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:56.015392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:56.015305    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:56.034626 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:56.033754    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt" podStartSLOduration=35.03373208 podStartE2EDuration="35.03373208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:30:55.921777383 +0000 UTC m=+68.946175861" watchObservedRunningTime="2026-07-24 01:30:56.03373208 +0000 UTC m=+69.058130560"
Jul 24 01:30:56.900169 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:56.899966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:56.902278 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:56.902057    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6fbcd9ccc5-75cjt"
Jul 24 01:30:58.442937 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:58.442895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:30:58.495950 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:30:58.495914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:00.445212 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:00.445160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:01.295804 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:01.295714    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:01.355407 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:01.355367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:01.408899 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:01.408857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:02.247408 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.247381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:02.261749 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.261713    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d875ff7f-22c8m"]
Jul 24 01:31:02.264066 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.264042    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.269040 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.269001    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 01:31:02.270686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.269989    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 01:31:02.270686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.270109    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 01:31:02.270686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.270339    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pp9zl\""
Jul 24 01:31:02.270686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.270528    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 01:31:02.270686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.270617    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 01:31:02.277150 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.277123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d875ff7f-22c8m"]
Jul 24 01:31:02.325565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.325465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-config\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.325565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.325510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgv5t\" (UniqueName: \"kubernetes.io/projected/ce4489a2-fcee-400f-8e26-a32117abdbfc-kube-api-access-rgv5t\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.325565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.325549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-oauth-serving-cert\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.325842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.325597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-service-ca\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.325842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.325622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-oauth-config\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.325842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.325638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-serving-cert\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.376728 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.376695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:02.426605 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.426503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-oauth-serving-cert\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.426605 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.426555    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-service-ca\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.426605 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.426586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-oauth-config\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.426605 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.426613    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-serving-cert\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.426965 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.426683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-config\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.426965 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.426709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgv5t\" (UniqueName: \"kubernetes.io/projected/ce4489a2-fcee-400f-8e26-a32117abdbfc-kube-api-access-rgv5t\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.427326 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.427300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-oauth-serving-cert\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.427443 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.427356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-service-ca\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.427873 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.427836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-config\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.429861 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.429837    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-oauth-config\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.429970 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.429954    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-serving-cert\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.434838 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.434794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgv5t\" (UniqueName: \"kubernetes.io/projected/ce4489a2-fcee-400f-8e26-a32117abdbfc-kube-api-access-rgv5t\") pod \"console-59d875ff7f-22c8m\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") " pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.481219 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.481119    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:02.576465 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.576414    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:02.930333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.930252    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:02.985906 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:02.985866    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:03.385148 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:03.385107    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:03.437704 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:03.437666    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:04.068839 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.068760    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8675f9ddcd-6bsrx"]
Jul 24 01:31:04.070970 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.070949    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.079377 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.079165    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 01:31:04.079377 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.079307    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:04.082303 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.082282    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675f9ddcd-6bsrx"]
Jul 24 01:31:04.138455 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.138414    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:04.143431 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-trusted-ca-bundle\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.143571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143445    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-console-config\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.143571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf5zk\" (UniqueName: \"kubernetes.io/projected/f46a5270-028e-49b0-ade2-177d095ce14e-kube-api-access-nf5zk\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.143571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-oauth-serving-cert\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.143571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-oauth-config\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.143745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-serving-cert\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.143745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.143589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-service-ca\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244325 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf5zk\" (UniqueName: \"kubernetes.io/projected/f46a5270-028e-49b0-ade2-177d095ce14e-kube-api-access-nf5zk\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244482 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-oauth-serving-cert\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244482 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-oauth-config\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244482 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-serving-cert\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244482 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-service-ca\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244482 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-trusted-ca-bundle\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.244686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.244487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-console-config\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.245164 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.245110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-oauth-serving-cert\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.245164 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.245156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-console-config\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.245412 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.245389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-service-ca\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.245640 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.245619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-trusted-ca-bundle\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.247521 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.247502    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-oauth-config\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.247661 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.247638    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-serving-cert\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.251674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.251655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf5zk\" (UniqueName: \"kubernetes.io/projected/f46a5270-028e-49b0-ade2-177d095ce14e-kube-api-access-nf5zk\") pod \"console-8675f9ddcd-6bsrx\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") " pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.382976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.382887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:04.423377 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.423332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:04.484825 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.484783    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:04.585492 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.585447    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:04.641584 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:04.641479    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:05.042300 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:05.042259    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:05.177488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:05.177453    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:08.250289 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:08.250244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:08.350726 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:08.350689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:11.247007 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.246675    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d875ff7f-22c8m"]
Jul 24 01:31:11.250958 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:11.250864    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4489a2_fcee_400f_8e26_a32117abdbfc.slice/crio-175b90c044e0fe9bd1128a067ba279effc81b6cd0ad5b1556af4fe57c95ee626 WatchSource:0}: Error finding container 175b90c044e0fe9bd1128a067ba279effc81b6cd0ad5b1556af4fe57c95ee626: Status 404 returned error can't find the container with id 175b90c044e0fe9bd1128a067ba279effc81b6cd0ad5b1556af4fe57c95ee626
Jul 24 01:31:11.287519 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.287458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675f9ddcd-6bsrx"]
Jul 24 01:31:11.552648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.552559    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:11.653291 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.653162    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:11.748919 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.748884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:11.866550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.866506    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:11.958789 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.958752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zfqjs" event={"ID":"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba","Type":"ContainerStarted","Data":"1b93d97cc8071b018ec206e3bc05d801b44b8d19facac84ee5fa4c8990209e0b"}
Jul 24 01:31:11.958977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.958815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zfqjs" event={"ID":"1f5c33ef-bd68-46ed-a7f0-018ce8d680ba","Type":"ContainerStarted","Data":"300f0eb2e5817d4120911bf1984a4a2f6fb89eb47f58d9383291c9308dab94a4"}
Jul 24 01:31:11.958977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.958850    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:31:11.961079 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.961052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qj6hm" event={"ID":"ee465a91-7a71-4825-b9af-38457c725db6","Type":"ContainerStarted","Data":"71dd401144bd2e7a8136091009e8556cfffa4d979d0d59ac9ca987277e1896d8"}
Jul 24 01:31:11.961302 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.961281    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qj6hm" event={"ID":"ee465a91-7a71-4825-b9af-38457c725db6","Type":"ContainerStarted","Data":"504e467f88e7596b8bebe9b35b46c297547695f93d03da11c6b03558a2a97a20"}
Jul 24 01:31:11.962920 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.962860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-vd9fr" event={"ID":"f80dd9d7-7bda-42f7-9145-7655e00c586f","Type":"ContainerStarted","Data":"d56539fc2d2a07a01dd3ad5e97aabf91d2e2611deeef7fe4d83e980761de34f9"}
Jul 24 01:31:11.963342 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.963226    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:31:11.964413 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.964383    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d875ff7f-22c8m" event={"ID":"ce4489a2-fcee-400f-8e26-a32117abdbfc","Type":"ContainerStarted","Data":"175b90c044e0fe9bd1128a067ba279effc81b6cd0ad5b1556af4fe57c95ee626"}
Jul 24 01:31:11.966455 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.966430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h2n47" event={"ID":"428c7226-3595-46d2-b65f-88b56844aa07","Type":"ContainerStarted","Data":"a2d3855a40c8f94cd6b2379b3bb4c18e4df827827e437eab7b4a811eebc587d6"}
Jul 24 01:31:11.968710 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.968690    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2krt" event={"ID":"be0aeed2-b8f1-4ac1-9a3b-acf786c0d792","Type":"ContainerStarted","Data":"40762673d3ec341670f6b600cf882402e30c5f8605c73446a7c89c02c84f59b6"}
Jul 24 01:31:11.970405 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.970378    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2b5xp" event={"ID":"80aef434-34a4-4586-b207-0ce8956ac5b7","Type":"ContainerStarted","Data":"5c9f5fbff400aaf5c14bdecb87ce80eea65e31fba32f2fe01eedcb348e42ef6c"}
Jul 24 01:31:11.970545 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.970529    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:31:11.972053 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.972032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2" event={"ID":"9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0","Type":"ContainerStarted","Data":"6e2887898f1962bcdb4c434be741c60b231c21016b1a73cea92eed124651e69f"}
Jul 24 01:31:11.973545 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.973515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675f9ddcd-6bsrx" event={"ID":"f46a5270-028e-49b0-ade2-177d095ce14e","Type":"ContainerStarted","Data":"e8786c166ba7a6d9c231b4bb0b573c78b24938332288438f68ea516c5c6fa40f"}
Jul 24 01:31:11.976098 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.976071    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-vd9fr"
Jul 24 01:31:11.980377 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.980330    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zfqjs" podStartSLOduration=35.3362712 podStartE2EDuration="50.980286681s" totalImagesPullingTime="15.644015481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:11.978986325 +0000 UTC m=+85.003384803" watchObservedRunningTime="2026-07-24 01:31:11.980286681 +0000 UTC m=+85.004685137"
Jul 24 01:31:11.994150 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:11.994092    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h2n47" podStartSLOduration=68.298491181 podStartE2EDuration="1m23.994073427s" totalImagesPullingTime="15.695582246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:11.992798627 +0000 UTC m=+85.017197105" watchObservedRunningTime="2026-07-24 01:31:11.994073427 +0000 UTC m=+85.018471902"
Jul 24 01:31:12.009476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.009426    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mh6j2" podStartSLOduration=35.316132359 podStartE2EDuration="51.009409952s" totalImagesPullingTime="15.693277593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:12.008687951 +0000 UTC m=+85.033086430" watchObservedRunningTime="2026-07-24 01:31:12.009409952 +0000 UTC m=+85.033808430"
Jul 24 01:31:12.009823 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.009790    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:12.029630 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.029578    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-vd9fr" podStartSLOduration=1.890102718 podStartE2EDuration="22.029560922s" totalImagesPullingTime="20.139458204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:12.028437774 +0000 UTC m=+85.052836252" watchObservedRunningTime="2026-07-24 01:31:12.029560922 +0000 UTC m=+85.053959401"
Jul 24 01:31:12.043608 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.043551    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2b5xp" podStartSLOduration=68.347779097 podStartE2EDuration="1m24.043532178s" totalImagesPullingTime="15.695753081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:12.041976161 +0000 UTC m=+85.066374633" watchObservedRunningTime="2026-07-24 01:31:12.043532178 +0000 UTC m=+85.067930657"
Jul 24 01:31:12.061117 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.061061    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qj6hm" podStartSLOduration=80.217048036 podStartE2EDuration="1m24.061041989s" totalImagesPullingTime="3.843993953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:12.059465011 +0000 UTC m=+85.083863487" watchObservedRunningTime="2026-07-24 01:31:12.061041989 +0000 UTC m=+85.085440468"
Jul 24 01:31:12.077211 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.077133    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j2krt" podStartSLOduration=17.848955304 podStartE2EDuration="43.077110405s" totalImagesPullingTime="25.228155101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 01:30:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:12.075901648 +0000 UTC m=+85.100300140" watchObservedRunningTime="2026-07-24 01:31:12.077110405 +0000 UTC m=+85.101508883"
Jul 24 01:31:12.108689 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.108656    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:12.309891 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.309774    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:12.406788 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:12.406751    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:13.468868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:13.468824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:13.570506 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:13.570474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:13.882119 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:13.881194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c6c967c67-6zgj9"
Jul 24 01:31:14.010292 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.010256    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:14.608403 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.608315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:14.715336 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.715297    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:14.791813 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.791781    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:14.794862 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.794830    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"]
Jul 24 01:31:14.814622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.814580    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"]
Jul 24 01:31:14.814855 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.814718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:14.818453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.818242    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 01:31:14.818453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.818277    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 01:31:14.818453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.818242    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9hwjw\""
Jul 24 01:31:14.818453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.818308    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 01:31:14.936856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.936730    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:14.936856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.936775    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkqmr\" (UniqueName: \"kubernetes.io/projected/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-kube-api-access-kkqmr\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:14.937192 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.937146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:14.937284 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:14.937224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.010345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.010311    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:15.038554 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.038508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.038749 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.038560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkqmr\" (UniqueName: \"kubernetes.io/projected/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-kube-api-access-kkqmr\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.038749 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.038635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.038749 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.038680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.039745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.039696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.041743 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.041720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.042248 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.042208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.053055 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.053017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkqmr\" (UniqueName: \"kubernetes.io/projected/ae468737-6c3a-4e5c-86e5-bffb3b9c6288-kube-api-access-kkqmr\") pod \"prometheus-operator-84d69f794d-kxlxn\" (UID: \"ae468737-6c3a-4e5c-86e5-bffb3b9c6288\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.128561 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.128518    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"
Jul 24 01:31:15.650445 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.650420    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kxlxn"]
Jul 24 01:31:15.653128 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:15.653102    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae468737_6c3a_4e5c_86e5_bffb3b9c6288.slice/crio-805f4c64c61b7fde57d096951b412222a22e008de5ffef6af4d9a16f6d97eded WatchSource:0}: Error finding container 805f4c64c61b7fde57d096951b412222a22e008de5ffef6af4d9a16f6d97eded: Status 404 returned error can't find the container with id 805f4c64c61b7fde57d096951b412222a22e008de5ffef6af4d9a16f6d97eded
Jul 24 01:31:15.999512 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:15.999468    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn" event={"ID":"ae468737-6c3a-4e5c-86e5-bffb3b9c6288","Type":"ContainerStarted","Data":"805f4c64c61b7fde57d096951b412222a22e008de5ffef6af4d9a16f6d97eded"}
Jul 24 01:31:17.006218 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:17.006161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d875ff7f-22c8m" event={"ID":"ce4489a2-fcee-400f-8e26-a32117abdbfc","Type":"ContainerStarted","Data":"db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c"}
Jul 24 01:31:17.008549 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:17.008516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675f9ddcd-6bsrx" event={"ID":"f46a5270-028e-49b0-ade2-177d095ce14e","Type":"ContainerStarted","Data":"12b196d922051db14ee6c479097da63834ba09d22a6c0cd7c6a84982510bfe43"}
Jul 24 01:31:17.042701 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:17.042645    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d875ff7f-22c8m" podStartSLOduration=10.284402451 podStartE2EDuration="15.042629793s" totalImagesPullingTime="4.758227342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:17.042347697 +0000 UTC m=+90.066746379" watchObservedRunningTime="2026-07-24 01:31:17.042629793 +0000 UTC m=+90.067028269"
Jul 24 01:31:17.077172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:17.077121    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8675f9ddcd-6bsrx" podStartSLOduration=8.385882328 podStartE2EDuration="13.077105354s" totalImagesPullingTime="4.691223026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:17.075770306 +0000 UTC m=+90.100168784" watchObservedRunningTime="2026-07-24 01:31:17.077105354 +0000 UTC m=+90.101503830"
Jul 24 01:31:17.859048 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:17.859006    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:18.015536 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:18.015442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn" event={"ID":"ae468737-6c3a-4e5c-86e5-bffb3b9c6288","Type":"ContainerStarted","Data":"b15ec70dd7d9a1a021f7e2daba5e65ada8bdef5f6d2af4355710f5b5c62ff778"}
Jul 24 01:31:18.015536 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:18.015522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn" event={"ID":"ae468737-6c3a-4e5c-86e5-bffb3b9c6288","Type":"ContainerStarted","Data":"80722252cddc2217aea681c1c7d08f9eda4db92429618d405e7f2c0d8d12791f"}
Jul 24 01:31:18.032880 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:18.032832    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-kxlxn" podStartSLOduration=2.178356272 podStartE2EDuration="4.032813837s" totalImagesPullingTime="1.854457565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:18.030841416 +0000 UTC m=+91.055239894" watchObservedRunningTime="2026-07-24 01:31:18.032813837 +0000 UTC m=+91.057212315"
Jul 24 01:31:18.388539 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:18.388454    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:18.444859 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:18.444813    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:19.882353 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:19.882317    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.106322 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.106288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.129476 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.129443    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"]
Jul 24 01:31:20.186939 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.186852    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"]
Jul 24 01:31:20.187114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.186993    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.187114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.187001    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t87w7"]
Jul 24 01:31:20.189080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189051    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be635144-a290-46bf-978a-5709a17da12a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.189236 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be635144-a290-46bf-978a-5709a17da12a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.189313 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be635144-a290-46bf-978a-5709a17da12a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.189390 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189307    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbkgx\" (UniqueName: \"kubernetes.io/projected/be635144-a290-46bf-978a-5709a17da12a-kube-api-access-jbkgx\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.189453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189406    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7gncp\""
Jul 24 01:31:20.189453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189412    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 01:31:20.189695 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.189670    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 01:31:20.207295 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.207274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.208711 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.208690    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.209499 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.209481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 01:31:20.209672 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.209657    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 01:31:20.209765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.209674    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p46tp\""
Jul 24 01:31:20.209829 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.209776    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 01:31:20.289717 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-sys\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.289717 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.289966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be635144-a290-46bf-978a-5709a17da12a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.289966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289814    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be635144-a290-46bf-978a-5709a17da12a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.289966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289838    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-root\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.289966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8fa1c32-1b78-4779-a425-37e1cb4ca733-metrics-client-ca\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.289966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-wtmp\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.289966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.290302 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.289963    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-accelerators-collector-config\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.290302 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.290002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxvc\" (UniqueName: \"kubernetes.io/projected/d8fa1c32-1b78-4779-a425-37e1cb4ca733-kube-api-access-4zxvc\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.290302 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.290046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be635144-a290-46bf-978a-5709a17da12a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.290302 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.290085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbkgx\" (UniqueName: \"kubernetes.io/projected/be635144-a290-46bf-978a-5709a17da12a-kube-api-access-jbkgx\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.290302 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.290100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-textfile\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.290753 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.290727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be635144-a290-46bf-978a-5709a17da12a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.292492 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.292462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be635144-a290-46bf-978a-5709a17da12a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.292615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.292593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be635144-a290-46bf-978a-5709a17da12a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.303529 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.303500    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbkgx\" (UniqueName: \"kubernetes.io/projected/be635144-a290-46bf-978a-5709a17da12a-kube-api-access-jbkgx\") pod \"openshift-state-metrics-b8f49f5c6-pzlv7\" (UID: \"be635144-a290-46bf-978a-5709a17da12a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.327722 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.327695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.391051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391016    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-textfile\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-sys\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-root\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8fa1c32-1b78-4779-a425-37e1cb4ca733-metrics-client-ca\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-wtmp\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-root\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-sys\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:31:20.391258    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-accelerators-collector-config\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxvc\" (UniqueName: \"kubernetes.io/projected/d8fa1c32-1b78-4779-a425-37e1cb4ca733-kube-api-access-4zxvc\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:31:20.391349    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls podName:d8fa1c32-1b78-4779-a425-37e1cb4ca733 nodeName:}" failed. No retries permitted until 2026-07-24 01:31:20.891324531 +0000 UTC m=+93.915723001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls") pod "node-exporter-t87w7" (UID: "d8fa1c32-1b78-4779-a425-37e1cb4ca733") : secret "node-exporter-tls" not found
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-wtmp\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391404    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-textfile\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.391981 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.391859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8fa1c32-1b78-4779-a425-37e1cb4ca733-metrics-client-ca\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.392079 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.392056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-accelerators-collector-config\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.393428 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.393412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.402193 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.402162    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxvc\" (UniqueName: \"kubernetes.io/projected/d8fa1c32-1b78-4779-a425-37e1cb4ca733-kube-api-access-4zxvc\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.427459 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.427430    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.499369 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.499332    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"
Jul 24 01:31:20.527907 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.527869    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.641330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.641300    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.663533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.663512    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7"]
Jul 24 01:31:20.665862 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:20.665841    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe635144_a290_46bf_978a_5709a17da12a.slice/crio-5d4a8f1c31fec732f47f526148160fb9e686e58e95bfcd6a1ea3be4bcb760f1f WatchSource:0}: Error finding container 5d4a8f1c31fec732f47f526148160fb9e686e58e95bfcd6a1ea3be4bcb760f1f: Status 404 returned error can't find the container with id 5d4a8f1c31fec732f47f526148160fb9e686e58e95bfcd6a1ea3be4bcb760f1f
Jul 24 01:31:20.743878 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.743853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.842626 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.842602    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:20.896722 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:20.896687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:20.897023 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:31:20.896820    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 01:31:20.897023 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:31:20.896879    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls podName:d8fa1c32-1b78-4779-a425-37e1cb4ca733 nodeName:}" failed. No retries permitted until 2026-07-24 01:31:21.896863132 +0000 UTC m=+94.921261587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls") pod "node-exporter-t87w7" (UID: "d8fa1c32-1b78-4779-a425-37e1cb4ca733") : secret "node-exporter-tls" not found
Jul 24 01:31:21.029364 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.029283    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7" event={"ID":"be635144-a290-46bf-978a-5709a17da12a","Type":"ContainerStarted","Data":"3057d5f31a95fee15b6eb190e45f64e6600d54cc169bcd76dcc6ae7717e57d0c"}
Jul 24 01:31:21.029364 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.029343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7" event={"ID":"be635144-a290-46bf-978a-5709a17da12a","Type":"ContainerStarted","Data":"cd590039dab7a462ef8deb95f7f371b0c3f541c495fc08820ad97fdc6fd6f47d"}
Jul 24 01:31:21.029364 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.029364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7" event={"ID":"be635144-a290-46bf-978a-5709a17da12a","Type":"ContainerStarted","Data":"5d4a8f1c31fec732f47f526148160fb9e686e58e95bfcd6a1ea3be4bcb760f1f"}
Jul 24 01:31:21.119746 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.119717    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:21.200399 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.200368    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:21.207790 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.207766    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 01:31:21.232243 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.230698    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 01:31:21.232243 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.230853    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.233865 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.233815    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 01:31:21.233865 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.233857    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 01:31:21.234061 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.233887    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 01:31:21.234134 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.234060    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 01:31:21.234299 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.234210    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 01:31:21.234299 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.234258    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l2g6k\""
Jul 24 01:31:21.234583 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.234568    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 01:31:21.234763 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.234749    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 01:31:21.234842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.234779    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 01:31:21.239787 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.239763    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 01:31:21.267093 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.267065    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:21.299913 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.299854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.299913 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.299885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f510e0-bd1f-4e9f-8dde-0b055573b466-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.299913 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.299903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4qgn\" (UniqueName: \"kubernetes.io/projected/70f510e0-bd1f-4e9f-8dde-0b055573b466-kube-api-access-v4qgn\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300147 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.299922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-config-volume\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300147 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.299939    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70f510e0-bd1f-4e9f-8dde-0b055573b466-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300147 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f510e0-bd1f-4e9f-8dde-0b055573b466-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300147 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f510e0-bd1f-4e9f-8dde-0b055573b466-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300147 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300120    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300207    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-web-config\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f510e0-bd1f-4e9f-8dde-0b055573b466-config-out\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300330    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.300429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.300361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401539 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-config-volume\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401700 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70f510e0-bd1f-4e9f-8dde-0b055573b466-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f510e0-bd1f-4e9f-8dde-0b055573b466-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f510e0-bd1f-4e9f-8dde-0b055573b466-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401872 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401872 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.401872 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-web-config\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401911    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f510e0-bd1f-4e9f-8dde-0b055573b466-config-out\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.401961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402143 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.402127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.402203    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70f510e0-bd1f-4e9f-8dde-0b055573b466-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402232 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.402218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402337 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.402257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f510e0-bd1f-4e9f-8dde-0b055573b466-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.402337 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.402285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4qgn\" (UniqueName: \"kubernetes.io/projected/70f510e0-bd1f-4e9f-8dde-0b055573b466-kube-api-access-v4qgn\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.403030 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:31:21.403007    2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 24 01:31:21.403162 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:31:21.403081    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-main-tls podName:70f510e0-bd1f-4e9f-8dde-0b055573b466 nodeName:}" failed. No retries permitted until 2026-07-24 01:31:21.903059145 +0000 UTC m=+94.927457602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "70f510e0-bd1f-4e9f-8dde-0b055573b466") : secret "alertmanager-main-tls" not found
Jul 24 01:31:21.404650 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.404626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f510e0-bd1f-4e9f-8dde-0b055573b466-config-out\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.404964 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.404930    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.405416 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.405395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f510e0-bd1f-4e9f-8dde-0b055573b466-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.405562 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.405540    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f510e0-bd1f-4e9f-8dde-0b055573b466-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.405943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.405917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.406517 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.406473    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.407694 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.407637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f510e0-bd1f-4e9f-8dde-0b055573b466-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.407820 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.407798    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-web-config\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.408001 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.407979    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.408396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.408377    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-config-volume\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.411235 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.411172    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4qgn\" (UniqueName: \"kubernetes.io/projected/70f510e0-bd1f-4e9f-8dde-0b055573b466-kube-api-access-v4qgn\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.627049 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.626956    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:21.906990 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.906911    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:21.906990 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.906964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.909188 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.909150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8fa1c32-1b78-4779-a425-37e1cb4ca733-node-exporter-tls\") pod \"node-exporter-t87w7\" (UID: \"d8fa1c32-1b78-4779-a425-37e1cb4ca733\") " pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:21.909433 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.909415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70f510e0-bd1f-4e9f-8dde-0b055573b466-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70f510e0-bd1f-4e9f-8dde-0b055573b466\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:21.985279 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:21.985249    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zfqjs"
Jul 24 01:31:22.017836 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:22.017809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t87w7"
Jul 24 01:31:22.049078 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:22.049049    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fa1c32_1b78_4779_a425_37e1cb4ca733.slice/crio-dc22cabe06f0c40a3d33b2ea478092f75ef74c85f19cb24d9924fc57fbcf9a15 WatchSource:0}: Error finding container dc22cabe06f0c40a3d33b2ea478092f75ef74c85f19cb24d9924fc57fbcf9a15: Status 404 returned error can't find the container with id dc22cabe06f0c40a3d33b2ea478092f75ef74c85f19cb24d9924fc57fbcf9a15
Jul 24 01:31:22.143097 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:22.143065    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 01:31:22.444226 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:22.444198    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 01:31:22.447210 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:22.447172    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f510e0_bd1f_4e9f_8dde_0b055573b466.slice/crio-e618f6c861ac3495067dd3a0160133de014f9382efa3796f537c53e45252656d WatchSource:0}: Error finding container e618f6c861ac3495067dd3a0160133de014f9382efa3796f537c53e45252656d: Status 404 returned error can't find the container with id e618f6c861ac3495067dd3a0160133de014f9382efa3796f537c53e45252656d
Jul 24 01:31:22.577115 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:22.577080    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:22.577316 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:22.577135    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:22.581866 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:22.581844    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:23.039571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.039534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7" event={"ID":"be635144-a290-46bf-978a-5709a17da12a","Type":"ContainerStarted","Data":"edd5303ba19cf02e63ddaba9c72e6da582a7d6eb26d5be9a9667dc86c2aa1d1b"}
Jul 24 01:31:23.041294 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.041267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t87w7" event={"ID":"d8fa1c32-1b78-4779-a425-37e1cb4ca733","Type":"ContainerStarted","Data":"dc22cabe06f0c40a3d33b2ea478092f75ef74c85f19cb24d9924fc57fbcf9a15"}
Jul 24 01:31:23.042414 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.042394    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"e618f6c861ac3495067dd3a0160133de014f9382efa3796f537c53e45252656d"}
Jul 24 01:31:23.046660 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.046641    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:31:23.060552 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.060493    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pzlv7" podStartSLOduration=1.64997503 podStartE2EDuration="3.060471759s" totalImagesPullingTime="1.410496729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:23.058983379 +0000 UTC m=+96.083381856" watchObservedRunningTime="2026-07-24 01:31:23.060471759 +0000 UTC m=+96.084870237"
Jul 24 01:31:23.091350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.091316    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:23.195947 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.195911    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:23.291919 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.291837    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:23.400469 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.400440    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:23.497200 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:23.497156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:24.383274 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.383252    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:24.383589 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.383324    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:24.387932 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.387914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:24.922793 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.922762    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"]
Jul 24 01:31:24.935565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.935525    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:24.940667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.940641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"]
Jul 24 01:31:24.940783 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.940683    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675f9ddcd-6bsrx"]
Jul 24 01:31:24.940783 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.940750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:24.942898 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.942881    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 01:31:24.943014 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.942902    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h2rgt\""
Jul 24 01:31:24.965340 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.965314    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb6bd659d-4pscj"]
Jul 24 01:31:24.985202 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.985160    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb6bd659d-4pscj"]
Jul 24 01:31:24.985299 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:24.985284    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.003614 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.003587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:25.032415 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032388    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gd2m\" (UniqueName: \"kubernetes.io/projected/27323087-855a-4e32-99bd-227dcfa58e41-kube-api-access-2gd2m\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.032535 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-console-config\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.032535 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-serving-cert\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.032607 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n27bs\" (UniqueName: \"kubernetes.io/projected/e4d0635f-e555-40b9-826a-42b1f8a71cd7-kube-api-access-n27bs\") pod \"monitoring-plugin-68b7fc9574-czxqk\" (UID: \"e4d0635f-e555-40b9-826a-42b1f8a71cd7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.032607 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032587    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-service-ca\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.032684 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032668    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-trusted-ca-bundle\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.032723 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-oauth-serving-cert\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.032723 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4d0635f-e555-40b9-826a-42b1f8a71cd7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-czxqk\" (UID: \"e4d0635f-e555-40b9-826a-42b1f8a71cd7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.032843 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.032741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-oauth-config\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.052978 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.052949    2568 generic.go:356] "Generic (PLEG): container finished" podID="70f510e0-bd1f-4e9f-8dde-0b055573b466" containerID="718f1c49d9fea46e27f17c4b363125ae38e841e4a0aae445d9543e522070614a" exitCode=0
Jul 24 01:31:25.053111 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.053032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerDied","Data":"718f1c49d9fea46e27f17c4b363125ae38e841e4a0aae445d9543e522070614a"}
Jul 24 01:31:25.054777 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.054759    2568 generic.go:356] "Generic (PLEG): container finished" podID="d8fa1c32-1b78-4779-a425-37e1cb4ca733" containerID="23f27f5daefb3566872ad341074363091842d52021eb91e166a75810178049e7" exitCode=0
Jul 24 01:31:25.054846 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.054822    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t87w7" event={"ID":"d8fa1c32-1b78-4779-a425-37e1cb4ca733","Type":"ContainerDied","Data":"23f27f5daefb3566872ad341074363091842d52021eb91e166a75810178049e7"}
Jul 24 01:31:25.059105 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.059089    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:25.133769 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.133736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n27bs\" (UniqueName: \"kubernetes.io/projected/e4d0635f-e555-40b9-826a-42b1f8a71cd7-kube-api-access-n27bs\") pod \"monitoring-plugin-68b7fc9574-czxqk\" (UID: \"e4d0635f-e555-40b9-826a-42b1f8a71cd7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.133966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.133946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-service-ca\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.134043 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-trusted-ca-bundle\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.134099 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-oauth-serving-cert\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.134157 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4d0635f-e555-40b9-826a-42b1f8a71cd7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-czxqk\" (UID: \"e4d0635f-e555-40b9-826a-42b1f8a71cd7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.134246 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-oauth-config\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.134320 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134304    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gd2m\" (UniqueName: \"kubernetes.io/projected/27323087-855a-4e32-99bd-227dcfa58e41-kube-api-access-2gd2m\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.135427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-console-config\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.135427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-serving-cert\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.135427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134947    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-trusted-ca-bundle\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.135427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.134971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-oauth-serving-cert\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.135427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.135260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-console-config\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.135751 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.135484    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-service-ca\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.137529 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.137497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-oauth-config\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.137632 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.137592    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-serving-cert\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.137826 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.137809    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4d0635f-e555-40b9-826a-42b1f8a71cd7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-czxqk\" (UID: \"e4d0635f-e555-40b9-826a-42b1f8a71cd7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.141073 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.141047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n27bs\" (UniqueName: \"kubernetes.io/projected/e4d0635f-e555-40b9-826a-42b1f8a71cd7-kube-api-access-n27bs\") pod \"monitoring-plugin-68b7fc9574-czxqk\" (UID: \"e4d0635f-e555-40b9-826a-42b1f8a71cd7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.141603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.141584    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gd2m\" (UniqueName: \"kubernetes.io/projected/27323087-855a-4e32-99bd-227dcfa58e41-kube-api-access-2gd2m\") pod \"console-7cb6bd659d-4pscj\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") " pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.143037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.143018    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:25.249736 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.249705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:25.302267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.302243    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:25.419108 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.419071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"]
Jul 24 01:31:25.422667 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:25.422622    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d0635f_e555_40b9_826a_42b1f8a71cd7.slice/crio-4f6c182003b7b6e2297c9e5e2b226647dad1d4ff505fbc4b1d885f5062563df2 WatchSource:0}: Error finding container 4f6c182003b7b6e2297c9e5e2b226647dad1d4ff505fbc4b1d885f5062563df2: Status 404 returned error can't find the container with id 4f6c182003b7b6e2297c9e5e2b226647dad1d4ff505fbc4b1d885f5062563df2
Jul 24 01:31:25.463747 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.463676    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb6bd659d-4pscj"]
Jul 24 01:31:25.466332 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:25.466309    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27323087_855a_4e32_99bd_227dcfa58e41.slice/crio-3f82248503cdb594cab45fd89b9439dea132433b946841c8e5e8b0b01e0bce26 WatchSource:0}: Error finding container 3f82248503cdb594cab45fd89b9439dea132433b946841c8e5e8b0b01e0bce26: Status 404 returned error can't find the container with id 3f82248503cdb594cab45fd89b9439dea132433b946841c8e5e8b0b01e0bce26
Jul 24 01:31:25.709444 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:25.709410    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:26.060370 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.060287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bd659d-4pscj" event={"ID":"27323087-855a-4e32-99bd-227dcfa58e41","Type":"ContainerStarted","Data":"ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d"}
Jul 24 01:31:26.060370 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.060339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bd659d-4pscj" event={"ID":"27323087-855a-4e32-99bd-227dcfa58e41","Type":"ContainerStarted","Data":"3f82248503cdb594cab45fd89b9439dea132433b946841c8e5e8b0b01e0bce26"}
Jul 24 01:31:26.062318 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.062294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t87w7" event={"ID":"d8fa1c32-1b78-4779-a425-37e1cb4ca733","Type":"ContainerStarted","Data":"11508e4b7b7942622ebad4ac409e57f69f032aeec6158a0b59228e3dc2274864"}
Jul 24 01:31:26.062474 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.062333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t87w7" event={"ID":"d8fa1c32-1b78-4779-a425-37e1cb4ca733","Type":"ContainerStarted","Data":"dc8d75bc8d98acc35d3a88ae0f8cd34de4cc0fb0da7c21d1d4e460528c771992"}
Jul 24 01:31:26.063454 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.063433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk" event={"ID":"e4d0635f-e555-40b9-826a-42b1f8a71cd7","Type":"ContainerStarted","Data":"4f6c182003b7b6e2297c9e5e2b226647dad1d4ff505fbc4b1d885f5062563df2"}
Jul 24 01:31:26.080172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.080129    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb6bd659d-4pscj" podStartSLOduration=2.080115209 podStartE2EDuration="2.080115209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:26.079234784 +0000 UTC m=+99.103633266" watchObservedRunningTime="2026-07-24 01:31:26.080115209 +0000 UTC m=+99.104513686"
Jul 24 01:31:26.101092 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.101046    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t87w7" podStartSLOduration=4.078393801 podStartE2EDuration="6.101031234s" totalImagesPullingTime="1.906967185s" totalInitContainerRuntime="115.670248ms" isStatefulPod=true podCreationTimestamp="2026-07-24 01:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:26.100314971 +0000 UTC m=+99.124713449" watchObservedRunningTime="2026-07-24 01:31:26.101031234 +0000 UTC m=+99.125429710"
Jul 24 01:31:26.113015 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.112989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:26.258829 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.258740    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:26.387846 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.387728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:26.393926 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.393897    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 01:31:26.410659 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.410624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.414243 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.414218    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cnm6f3qim8kdj\""
Jul 24 01:31:26.414381 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.414333    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 01:31:26.414381 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.414341    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 01:31:26.418436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.418096    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 01:31:26.418436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.418112    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 01:31:26.418436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.418118    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 01:31:26.418436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.418149    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 01:31:26.418836 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.418650    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 01:31:26.418902 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.418886    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 01:31:26.419208 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.419074    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 01:31:26.419609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.419268    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g9cmw\""
Jul 24 01:31:26.419609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.419312    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 01:31:26.419751 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.419672    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 01:31:26.419862 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.419782    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 01:31:26.420565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.420328    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 01:31:26.422191 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.422155    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 01:31:26.427289 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.427062    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 01:31:26.443907 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.443874    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 01:31:26.446846 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.446823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.446973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.446869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.446973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.446892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27nx\" (UniqueName: \"kubernetes.io/projected/bc330080-74bc-40b6-a33e-50e06fb000c3-kube-api-access-z27nx\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.446973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.446927    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.446973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.446957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447152 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.446983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-config\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447152 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447152 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447152 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447152 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447356    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.447440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.450020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc330080-74bc-40b6-a33e-50e06fb000c3-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.450020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.447483    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc330080-74bc-40b6-a33e-50e06fb000c3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.547976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.547942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.547976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.547981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-config\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548267    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.548394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc330080-74bc-40b6-a33e-50e06fb000c3-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc330080-74bc-40b6-a33e-50e06fb000c3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548654    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27nx\" (UniqueName: \"kubernetes.io/projected/bc330080-74bc-40b6-a33e-50e06fb000c3-kube-api-access-z27nx\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.549442 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.548759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.550049 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.550019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.551868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.550617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.551868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.550738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.551868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.551338    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.555133 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.554717    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.557192 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.555335    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.557192 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.556468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc330080-74bc-40b6-a33e-50e06fb000c3-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.557192 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.556478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.557865 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.557839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.558926 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.558883    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.560948 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.560086    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.560948 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.560795    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc330080-74bc-40b6-a33e-50e06fb000c3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.564074 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.564025    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-config\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.564292 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.564229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc330080-74bc-40b6-a33e-50e06fb000c3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.564753 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.564593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.565122 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.565089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.565468 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.565444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.565563 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.565497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.565850 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.565828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc330080-74bc-40b6-a33e-50e06fb000c3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.568102 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.568009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27nx\" (UniqueName: \"kubernetes.io/projected/bc330080-74bc-40b6-a33e-50e06fb000c3-kube-api-access-z27nx\") pod \"prometheus-k8s-0\" (UID: \"bc330080-74bc-40b6-a33e-50e06fb000c3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:26.722886 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:26.722825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:27.930725 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:27.930629    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 01:31:27.933332 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:31:27.933302    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc330080_74bc_40b6_a33e_50e06fb000c3.slice/crio-f70122b822c48566b43a1c11662b1e2f7e4955ea54cb9510edb3635b8e35818e WatchSource:0}: Error finding container f70122b822c48566b43a1c11662b1e2f7e4955ea54cb9510edb3635b8e35818e: Status 404 returned error can't find the container with id f70122b822c48566b43a1c11662b1e2f7e4955ea54cb9510edb3635b8e35818e
Jul 24 01:31:28.074939 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.074912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk" event={"ID":"e4d0635f-e555-40b9-826a-42b1f8a71cd7","Type":"ContainerStarted","Data":"cc5cf1fd574c9d22b8a01684f3af8b675bdf01e7a5d4c0dd66270ba0b903ecad"}
Jul 24 01:31:28.075066 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.075043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:28.076702 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.076678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"0cf9fda15d450996ce62e63b2b4ad9efa96b98971bda49bc6de03caca075ab27"}
Jul 24 01:31:28.076820 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.076733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"f70122b822c48566b43a1c11662b1e2f7e4955ea54cb9510edb3635b8e35818e"}
Jul 24 01:31:28.079163 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.079142    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"0abd61010bffd642bf9f844aacb71d077c2e5584900a3494146e2ca487915d29"}
Jul 24 01:31:28.079266 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.079215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"8fe7e6da9d2d7adf202e803aecf0197e937f1ef9661a0f8fa45fa92ab850d30b"}
Jul 24 01:31:28.080225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.080208    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk"
Jul 24 01:31:28.090040 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:28.089982    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-czxqk" podStartSLOduration=1.720816034 podStartE2EDuration="4.089969421s" totalImagesPullingTime="2.369153387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:28.08930871 +0000 UTC m=+101.113707187" watchObservedRunningTime="2026-07-24 01:31:28.089969421 +0000 UTC m=+101.114367898"
Jul 24 01:31:29.087263 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:29.086554    2568 generic.go:356] "Generic (PLEG): container finished" podID="bc330080-74bc-40b6-a33e-50e06fb000c3" containerID="0cf9fda15d450996ce62e63b2b4ad9efa96b98971bda49bc6de03caca075ab27" exitCode=0
Jul 24 01:31:29.087263 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:29.086680    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerDied","Data":"0cf9fda15d450996ce62e63b2b4ad9efa96b98971bda49bc6de03caca075ab27"}
Jul 24 01:31:29.090990 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:29.090954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"b1022e873ab5c9fd28b1db8d7165feec0e38161a00915b71f45e0ddeb8ae6919"}
Jul 24 01:31:29.091065 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:29.091027    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"cf45d87fc2d2e00a35ef602320a6e278ecfefd375fff0c1e132110646f63844d"}
Jul 24 01:31:29.091065 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:29.091060    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"64a978d92f692bad551e06f5a9e1fb1611174be320301a4ab352115c2f731caa"}
Jul 24 01:31:30.100640 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:30.100599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70f510e0-bd1f-4e9f-8dde-0b055573b466","Type":"ContainerStarted","Data":"25206047514b2c881965e01df6da8982361eec4eacc784989c03face57d5fb01"}
Jul 24 01:31:30.127441 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:30.126936    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.493602073 podStartE2EDuration="9.126915828s" totalImagesPullingTime="5.618331965s" totalInitContainerRuntime="14.98179ms" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:30.12413482 +0000 UTC m=+103.148533299" watchObservedRunningTime="2026-07-24 01:31:30.126915828 +0000 UTC m=+103.151314308"
Jul 24 01:31:31.130769 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:31.130736    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:31.236858 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:31.236824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:33.118235 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:33.118207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"7fb447f51a4bed047a372e1ff984bd95c81d7dba0b93da0fa34bcd9cd74b8c60"}
Jul 24 01:31:33.118580 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:33.118291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"aa24080cf871b09bae9efdee4f244cfb4d8ab01faf763008392897c6dfb03e88"}
Jul 24 01:31:33.382691 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:33.382585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:33.433480 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:33.433450    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:35.304522 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:35.304493    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:35.304938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:35.304560    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:35.308592 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:35.308572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:36.136665 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.136630    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"329380d5c32e57b55e5370e5569dd39ddfd20434e661da81053d6156f885ee7b"}
Jul 24 01:31:36.136910 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.136698    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"5afaccfe04f3680605029cff45f091d2349ec7826737479c79a73e267f33f1c5"}
Jul 24 01:31:36.136910 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.136729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"08dfd8f767cc43aeaec8c97cd8c79789e1e03f50acb57f3f7270cbfd1e52f8f3"}
Jul 24 01:31:36.136910 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.136768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc330080-74bc-40b6-a33e-50e06fb000c3","Type":"ContainerStarted","Data":"6ad99800af5e595fef2ed5765d2bdfe17a0f2791b22efaa0c1b1ee546846023c"}
Jul 24 01:31:36.140873 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.140852    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:31:36.163102 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.163051    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.237134091 podStartE2EDuration="10.163035333s" totalImagesPullingTime="5.889543482s" totalInitContainerRuntime="36.35776ms" isStatefulPod=false podCreationTimestamp="2026-07-24 01:31:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:31:36.161153104 +0000 UTC m=+109.185551626" watchObservedRunningTime="2026-07-24 01:31:36.163035333 +0000 UTC m=+109.187433824"
Jul 24 01:31:36.206135 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.206100    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d875ff7f-22c8m"]
Jul 24 01:31:36.341270 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.341239    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:36.443282 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.443250    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:36.542489 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.542460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:36.723824 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:36.723738    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:31:42.984892 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:42.984862    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2b5xp"
Jul 24 01:31:48.185923 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:48.185890    2568 generic.go:356] "Generic (PLEG): container finished" podID="09738bcf-a949-4759-8d47-3d72bc990fa8" containerID="d56f4661985357b6aec5ad8ad121c1249ec416cadbb9d63536b81b09672a520c" exitCode=0
Jul 24 01:31:48.186324 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:48.185961    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls" event={"ID":"09738bcf-a949-4759-8d47-3d72bc990fa8","Type":"ContainerDied","Data":"d56f4661985357b6aec5ad8ad121c1249ec416cadbb9d63536b81b09672a520c"}
Jul 24 01:31:48.186324 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:48.186294    2568 scope.go:117] "RemoveContainer" containerID="d56f4661985357b6aec5ad8ad121c1249ec416cadbb9d63536b81b09672a520c"
Jul 24 01:31:48.426333 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:48.426296    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:48.480341 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:48.480308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:49.191569 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:49.191536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-swkls" event={"ID":"09738bcf-a949-4759-8d47-3d72bc990fa8","Type":"ContainerStarted","Data":"a6125286f91a20f4f216ab8cda082739d05124f849ef1f907d85e65e3cd7b23e"}
Jul 24 01:31:51.082249 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.082172    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8675f9ddcd-6bsrx" podUID="f46a5270-028e-49b0-ade2-177d095ce14e" containerName="console" containerID="cri-o://12b196d922051db14ee6c479097da63834ba09d22a6c0cd7c6a84982510bfe43" gracePeriod=15
Jul 24 01:31:51.201494 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.201462    2568 generic.go:356] "Generic (PLEG): container finished" podID="f46a5270-028e-49b0-ade2-177d095ce14e" containerID="12b196d922051db14ee6c479097da63834ba09d22a6c0cd7c6a84982510bfe43" exitCode=0
Jul 24 01:31:51.201634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.201534    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675f9ddcd-6bsrx" event={"ID":"f46a5270-028e-49b0-ade2-177d095ce14e","Type":"ContainerDied","Data":"12b196d922051db14ee6c479097da63834ba09d22a6c0cd7c6a84982510bfe43"}
Jul 24 01:31:51.366254 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.366170    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:51.480562 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480533    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-oauth-config\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.480764 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-trusted-ca-bundle\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.480764 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480610    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-console-config\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.480764 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480635    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-service-ca\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.480764 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480690    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf5zk\" (UniqueName: \"kubernetes.io/projected/f46a5270-028e-49b0-ade2-177d095ce14e-kube-api-access-nf5zk\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.480764 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480712    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-oauth-serving-cert\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.481009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.480773    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-serving-cert\") pod \"f46a5270-028e-49b0-ade2-177d095ce14e\" (UID: \"f46a5270-028e-49b0-ade2-177d095ce14e\") "
Jul 24 01:31:51.481126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.481091    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:31:51.481222 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.481149    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-console-config" (OuterVolumeSpecName: "console-config") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:31:51.481222 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.481202    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:31:51.481222 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.481207    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:31:51.483059 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.483030    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46a5270-028e-49b0-ade2-177d095ce14e-kube-api-access-nf5zk" (OuterVolumeSpecName: "kube-api-access-nf5zk") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "kube-api-access-nf5zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:31:51.483059 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.483038    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:31:51.483316 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.483081    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f46a5270-028e-49b0-ade2-177d095ce14e" (UID: "f46a5270-028e-49b0-ade2-177d095ce14e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:31:51.582385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582351    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf5zk\" (UniqueName: \"kubernetes.io/projected/f46a5270-028e-49b0-ade2-177d095ce14e-kube-api-access-nf5zk\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:51.582385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582380    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-oauth-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:51.582385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582389    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:51.582385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582397    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f46a5270-028e-49b0-ade2-177d095ce14e-console-oauth-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:51.582663 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582406    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-trusted-ca-bundle\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:51.582663 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582415    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-console-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:51.582663 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:51.582423    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f46a5270-028e-49b0-ade2-177d095ce14e-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:31:52.206797 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:52.206761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675f9ddcd-6bsrx" event={"ID":"f46a5270-028e-49b0-ade2-177d095ce14e","Type":"ContainerDied","Data":"e8786c166ba7a6d9c231b4bb0b573c78b24938332288438f68ea516c5c6fa40f"}
Jul 24 01:31:52.207312 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:52.206816    2568 scope.go:117] "RemoveContainer" containerID="12b196d922051db14ee6c479097da63834ba09d22a6c0cd7c6a84982510bfe43"
Jul 24 01:31:52.207312 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:52.206772    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675f9ddcd-6bsrx"
Jul 24 01:31:52.221777 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:52.221753    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675f9ddcd-6bsrx"]
Jul 24 01:31:52.225566 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:52.225544    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8675f9ddcd-6bsrx"]
Jul 24 01:31:53.504899 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:53.504862    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46a5270-028e-49b0-ade2-177d095ce14e" path="/var/lib/kubelet/pods/f46a5270-028e-49b0-ade2-177d095ce14e/volumes"
Jul 24 01:31:54.465883 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:54.465846    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:55.706606 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:55.706554    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:55.808093 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:55.808062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:31:55.909716 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:31:55.909683    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:01.224823 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.224786    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59d875ff7f-22c8m" podUID="ce4489a2-fcee-400f-8e26-a32117abdbfc" containerName="console" containerID="cri-o://db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c" gracePeriod=15
Jul 24 01:32:01.511225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.511199    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:32:01.580446 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580414    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-service-ca\") pod \"ce4489a2-fcee-400f-8e26-a32117abdbfc\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") "
Jul 24 01:32:01.580634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580460    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-oauth-serving-cert\") pod \"ce4489a2-fcee-400f-8e26-a32117abdbfc\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") "
Jul 24 01:32:01.580634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580479    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-serving-cert\") pod \"ce4489a2-fcee-400f-8e26-a32117abdbfc\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") "
Jul 24 01:32:01.580634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580507    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-config\") pod \"ce4489a2-fcee-400f-8e26-a32117abdbfc\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") "
Jul 24 01:32:01.580634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580573    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgv5t\" (UniqueName: \"kubernetes.io/projected/ce4489a2-fcee-400f-8e26-a32117abdbfc-kube-api-access-rgv5t\") pod \"ce4489a2-fcee-400f-8e26-a32117abdbfc\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") "
Jul 24 01:32:01.580634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580608    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-oauth-config\") pod \"ce4489a2-fcee-400f-8e26-a32117abdbfc\" (UID: \"ce4489a2-fcee-400f-8e26-a32117abdbfc\") "
Jul 24 01:32:01.580952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-service-ca" (OuterVolumeSpecName: "service-ca") pod "ce4489a2-fcee-400f-8e26-a32117abdbfc" (UID: "ce4489a2-fcee-400f-8e26-a32117abdbfc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:32:01.580952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580938    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-config" (OuterVolumeSpecName: "console-config") pod "ce4489a2-fcee-400f-8e26-a32117abdbfc" (UID: "ce4489a2-fcee-400f-8e26-a32117abdbfc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:32:01.581081 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.580944    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ce4489a2-fcee-400f-8e26-a32117abdbfc" (UID: "ce4489a2-fcee-400f-8e26-a32117abdbfc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:32:01.582852 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.582828    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ce4489a2-fcee-400f-8e26-a32117abdbfc" (UID: "ce4489a2-fcee-400f-8e26-a32117abdbfc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:32:01.582947 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.582856    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce4489a2-fcee-400f-8e26-a32117abdbfc-kube-api-access-rgv5t" (OuterVolumeSpecName: "kube-api-access-rgv5t") pod "ce4489a2-fcee-400f-8e26-a32117abdbfc" (UID: "ce4489a2-fcee-400f-8e26-a32117abdbfc"). InnerVolumeSpecName "kube-api-access-rgv5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:32:01.582947 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.582908    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ce4489a2-fcee-400f-8e26-a32117abdbfc" (UID: "ce4489a2-fcee-400f-8e26-a32117abdbfc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:32:01.681401 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.681366    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:32:01.681401 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.681397    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-oauth-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:32:01.681401 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.681408    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:32:01.681617 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.681416    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:32:01.681617 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.681426    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgv5t\" (UniqueName: \"kubernetes.io/projected/ce4489a2-fcee-400f-8e26-a32117abdbfc-kube-api-access-rgv5t\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:32:01.681617 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:01.681436    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce4489a2-fcee-400f-8e26-a32117abdbfc-console-oauth-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:32:02.247479 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.247447    2568 generic.go:356] "Generic (PLEG): container finished" podID="ce4489a2-fcee-400f-8e26-a32117abdbfc" containerID="db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c" exitCode=0
Jul 24 01:32:02.247881 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.247486    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d875ff7f-22c8m"
Jul 24 01:32:02.247881 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.247536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d875ff7f-22c8m" event={"ID":"ce4489a2-fcee-400f-8e26-a32117abdbfc","Type":"ContainerDied","Data":"db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c"}
Jul 24 01:32:02.247881 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.247583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d875ff7f-22c8m" event={"ID":"ce4489a2-fcee-400f-8e26-a32117abdbfc","Type":"ContainerDied","Data":"175b90c044e0fe9bd1128a067ba279effc81b6cd0ad5b1556af4fe57c95ee626"}
Jul 24 01:32:02.247881 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.247603    2568 scope.go:117] "RemoveContainer" containerID="db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c"
Jul 24 01:32:02.257677 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.257643    2568 scope.go:117] "RemoveContainer" containerID="db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c"
Jul 24 01:32:02.258047 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:32:02.258025    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c\": container with ID starting with db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c not found: ID does not exist" containerID="db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c"
Jul 24 01:32:02.258136 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.258058    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c"} err="failed to get container status \"db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c\": rpc error: code = NotFound desc = could not find container \"db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c\": container with ID starting with db564095a3030e8ba4fab49443053ff5bd3ceeed989149c179311bebfa9b162c not found: ID does not exist"
Jul 24 01:32:02.270210 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.270190    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d875ff7f-22c8m"]
Jul 24 01:32:02.273510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:02.273491    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59d875ff7f-22c8m"]
Jul 24 01:32:03.508696 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:03.508662    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce4489a2-fcee-400f-8e26-a32117abdbfc" path="/var/lib/kubelet/pods/ce4489a2-fcee-400f-8e26-a32117abdbfc/volumes"
Jul 24 01:32:26.723516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:26.723475    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:32:26.741252 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:26.741226    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:32:27.361010 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:27.360982    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 01:32:39.387202 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:39.387078    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:39.588724 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:39.588682    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:49.585112 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585077    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d666c4ffd-4sqpj"]
Jul 24 01:32:49.585560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585510    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46a5270-028e-49b0-ade2-177d095ce14e" containerName="console"
Jul 24 01:32:49.585560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585525    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46a5270-028e-49b0-ade2-177d095ce14e" containerName="console"
Jul 24 01:32:49.585560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585540    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce4489a2-fcee-400f-8e26-a32117abdbfc" containerName="console"
Jul 24 01:32:49.585560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585548    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce4489a2-fcee-400f-8e26-a32117abdbfc" containerName="console"
Jul 24 01:32:49.585698 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585627    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f46a5270-028e-49b0-ade2-177d095ce14e" containerName="console"
Jul 24 01:32:49.585698 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.585637    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce4489a2-fcee-400f-8e26-a32117abdbfc" containerName="console"
Jul 24 01:32:49.588412 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.588396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.600957 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.600919    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d666c4ffd-4sqpj"]
Jul 24 01:32:49.635480 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.635438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:49.686066 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-oauth-config\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.686277 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-oauth-serving-cert\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.686277 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686228    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-console-config\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.686400 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-service-ca\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.686457 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmnbw\" (UniqueName: \"kubernetes.io/projected/cca212a5-762b-4712-a14a-f14b08a777e0-kube-api-access-xmnbw\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.686568 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-serving-cert\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.686660 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.686573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-trusted-ca-bundle\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.737623 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.737575    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:49.787787 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-oauth-config\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.787787 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-oauth-serving-cert\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-console-config\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-service-ca\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787887    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmnbw\" (UniqueName: \"kubernetes.io/projected/cca212a5-762b-4712-a14a-f14b08a777e0-kube-api-access-xmnbw\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-serving-cert\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788037 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.787972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-trusted-ca-bundle\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788705 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.788677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-oauth-serving-cert\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788818 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.788684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-console-config\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788818 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.788718    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-service-ca\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.788818 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.788793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-trusted-ca-bundle\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.790458 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.790437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-oauth-config\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.790566 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.790457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-serving-cert\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.795759 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.795737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmnbw\" (UniqueName: \"kubernetes.io/projected/cca212a5-762b-4712-a14a-f14b08a777e0-kube-api-access-xmnbw\") pod \"console-7d666c4ffd-4sqpj\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") " pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:49.835842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.835746    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:49.901878 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:49.901843    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:50.040378 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:50.040353    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d666c4ffd-4sqpj"]
Jul 24 01:32:50.043111 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:32:50.043088    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca212a5_762b_4712_a14a_f14b08a777e0.slice/crio-b4ee79d2c6ada79111dce24e50f36e924597599fa708338dbeab1b6b5f577f1a WatchSource:0}: Error finding container b4ee79d2c6ada79111dce24e50f36e924597599fa708338dbeab1b6b5f577f1a: Status 404 returned error can't find the container with id b4ee79d2c6ada79111dce24e50f36e924597599fa708338dbeab1b6b5f577f1a
Jul 24 01:32:50.437912 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:50.437885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d666c4ffd-4sqpj" event={"ID":"cca212a5-762b-4712-a14a-f14b08a777e0","Type":"ContainerStarted","Data":"48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007"}
Jul 24 01:32:50.438246 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:50.437933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d666c4ffd-4sqpj" event={"ID":"cca212a5-762b-4712-a14a-f14b08a777e0","Type":"ContainerStarted","Data":"b4ee79d2c6ada79111dce24e50f36e924597599fa708338dbeab1b6b5f577f1a"}
Jul 24 01:32:50.455296 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:50.455243    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d666c4ffd-4sqpj" podStartSLOduration=1.4552270809999999 podStartE2EDuration="1.455227081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:32:50.453856006 +0000 UTC m=+183.478254483" watchObservedRunningTime="2026-07-24 01:32:50.455227081 +0000 UTC m=+183.479625558"
Jul 24 01:32:54.642687 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:54.642654    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:54.703360 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:54.703326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:32:59.902926 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:59.902883    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:59.903393 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:59.902945    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:32:59.907606 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:32:59.907583    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:33:00.479478 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.479453    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:33:00.525945 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.525910    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb6bd659d-4pscj"]
Jul 24 01:33:00.646103 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.646069    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b9c5dc4c-59d59"]
Jul 24 01:33:00.648470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.648454    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.657526 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.657504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b9c5dc4c-59d59"]
Jul 24 01:33:00.657736 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.657717    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:00.677217 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-serving-cert\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.677330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-service-ca\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.677330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677266    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-oauth-config\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.677399 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-config\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.677399 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677374    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-oauth-serving-cert\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.677461 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-trusted-ca-bundle\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.677496 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.677456    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgkmz\" (UniqueName: \"kubernetes.io/projected/6dda124a-76af-43b3-b0e6-64a6f1ab726e-kube-api-access-mgkmz\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.756902 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.756824    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:00.777996 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.777967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-config\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.777998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-oauth-serving-cert\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-trusted-ca-bundle\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778086    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgkmz\" (UniqueName: \"kubernetes.io/projected/6dda124a-76af-43b3-b0e6-64a6f1ab726e-kube-api-access-mgkmz\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-serving-cert\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-service-ca\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-oauth-config\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.778859 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-config\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.779011 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-trusted-ca-bundle\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.779121 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778947    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-oauth-serving-cert\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.779121 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.778989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-service-ca\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.780712 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.780691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-serving-cert\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.780798 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.780743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-oauth-config\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.785665 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.785641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgkmz\" (UniqueName: \"kubernetes.io/projected/6dda124a-76af-43b3-b0e6-64a6f1ab726e-kube-api-access-mgkmz\") pod \"console-57b9c5dc4c-59d59\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") " pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:00.958836 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:00.958801    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:01.085156 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:01.085125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b9c5dc4c-59d59"]
Jul 24 01:33:01.087915 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:33:01.087887    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dda124a_76af_43b3_b0e6_64a6f1ab726e.slice/crio-9d92c70e1b2ce2ea7fa4e8e06901c67f98d0e9c1a5445d198f314030e4067095 WatchSource:0}: Error finding container 9d92c70e1b2ce2ea7fa4e8e06901c67f98d0e9c1a5445d198f314030e4067095: Status 404 returned error can't find the container with id 9d92c70e1b2ce2ea7fa4e8e06901c67f98d0e9c1a5445d198f314030e4067095
Jul 24 01:33:01.439665 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:01.439633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:01.481242 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:01.481204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b9c5dc4c-59d59" event={"ID":"6dda124a-76af-43b3-b0e6-64a6f1ab726e","Type":"ContainerStarted","Data":"b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0"}
Jul 24 01:33:01.481396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:01.481256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b9c5dc4c-59d59" event={"ID":"6dda124a-76af-43b3-b0e6-64a6f1ab726e","Type":"ContainerStarted","Data":"9d92c70e1b2ce2ea7fa4e8e06901c67f98d0e9c1a5445d198f314030e4067095"}
Jul 24 01:33:01.487913 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:01.487892    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:01.499046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:01.498997    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b9c5dc4c-59d59" podStartSLOduration=1.498976478 podStartE2EDuration="1.498976478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:33:01.497113832 +0000 UTC m=+194.521512306" watchObservedRunningTime="2026-07-24 01:33:01.498976478 +0000 UTC m=+194.523374982"
Jul 24 01:33:06.612246 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:06.612209    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:06.661306 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:06.661277    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:10.959994 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:10.959952    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:10.960432 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:10.960013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:10.964780 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:10.964760    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:11.527790 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:11.523609    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:33:11.566155 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:11.566125    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d666c4ffd-4sqpj"]
Jul 24 01:33:11.694758 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:11.694729    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:11.795186 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:11.795093    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:11.842653 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:11.842617    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:18.393045 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:18.393006    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:18.491780 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:18.491746    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:33:25.546283 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.546222    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cb6bd659d-4pscj" podUID="27323087-855a-4e32-99bd-227dcfa58e41" containerName="console" containerID="cri-o://ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d" gracePeriod=15
Jul 24 01:33:25.792872 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.792736    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:33:25.908242 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908141    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-oauth-serving-cert\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908242 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908202    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-oauth-config\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-console-config\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908298    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-service-ca\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908339    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-serving-cert\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908358    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-trusted-ca-bundle\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908429 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908384    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gd2m\" (UniqueName: \"kubernetes.io/projected/27323087-855a-4e32-99bd-227dcfa58e41-kube-api-access-2gd2m\") pod \"27323087-855a-4e32-99bd-227dcfa58e41\" (UID: \"27323087-855a-4e32-99bd-227dcfa58e41\") "
Jul 24 01:33:25.908703 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908530    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:25.908703 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908663    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-oauth-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:25.908811 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908763    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-console-config" (OuterVolumeSpecName: "console-config") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:25.908811 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908786    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-service-ca" (OuterVolumeSpecName: "service-ca") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:25.908886 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.908795    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:25.910393 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.910362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:33:25.910490 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.910433    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:33:25.910574 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:25.910551    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27323087-855a-4e32-99bd-227dcfa58e41-kube-api-access-2gd2m" (OuterVolumeSpecName: "kube-api-access-2gd2m") pod "27323087-855a-4e32-99bd-227dcfa58e41" (UID: "27323087-855a-4e32-99bd-227dcfa58e41"). InnerVolumeSpecName "kube-api-access-2gd2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:33:26.009094 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.009046    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-console-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:26.009094 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.009087    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:26.009094 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.009096    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:26.009094 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.009104    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27323087-855a-4e32-99bd-227dcfa58e41-trusted-ca-bundle\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:26.009364 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.009113    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gd2m\" (UniqueName: \"kubernetes.io/projected/27323087-855a-4e32-99bd-227dcfa58e41-kube-api-access-2gd2m\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:26.009364 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.009122    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27323087-855a-4e32-99bd-227dcfa58e41-console-oauth-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:26.578953 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.578915    2568 generic.go:356] "Generic (PLEG): container finished" podID="27323087-855a-4e32-99bd-227dcfa58e41" containerID="ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d" exitCode=0
Jul 24 01:33:26.578953 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.578957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bd659d-4pscj" event={"ID":"27323087-855a-4e32-99bd-227dcfa58e41","Type":"ContainerDied","Data":"ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d"}
Jul 24 01:33:26.579464 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.578997    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb6bd659d-4pscj" event={"ID":"27323087-855a-4e32-99bd-227dcfa58e41","Type":"ContainerDied","Data":"3f82248503cdb594cab45fd89b9439dea132433b946841c8e5e8b0b01e0bce26"}
Jul 24 01:33:26.579464 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.579018    2568 scope.go:117] "RemoveContainer" containerID="ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d"
Jul 24 01:33:26.579464 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.578958    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb6bd659d-4pscj"
Jul 24 01:33:26.588628 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.588490    2568 scope.go:117] "RemoveContainer" containerID="ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d"
Jul 24 01:33:26.589753 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:33:26.589729    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d\": container with ID starting with ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d not found: ID does not exist" containerID="ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d"
Jul 24 01:33:26.589846 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.589758    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d"} err="failed to get container status \"ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d\": rpc error: code = NotFound desc = could not find container \"ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d\": container with ID starting with ecd770eba755bda2c99874bf3096e96d852dcc132e2e3a4e04ea0d99b235ce0d not found: ID does not exist"
Jul 24 01:33:26.600292 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.600267    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb6bd659d-4pscj"]
Jul 24 01:33:26.603936 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:26.603916    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb6bd659d-4pscj"]
Jul 24 01:33:27.504236 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:27.504203    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27323087-855a-4e32-99bd-227dcfa58e41" path="/var/lib/kubelet/pods/27323087-855a-4e32-99bd-227dcfa58e41/volumes"
Jul 24 01:33:36.591560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:36.591520    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d666c4ffd-4sqpj" podUID="cca212a5-762b-4712-a14a-f14b08a777e0" containerName="console" containerID="cri-o://48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007" gracePeriod=15
Jul 24 01:33:36.834689 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:36.834663    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:33:37.013080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013046    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-trusted-ca-bundle\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013275 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013100    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-service-ca\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013275 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013206    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmnbw\" (UniqueName: \"kubernetes.io/projected/cca212a5-762b-4712-a14a-f14b08a777e0-kube-api-access-xmnbw\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013275 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-serving-cert\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013296    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-console-config\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013329    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-oauth-serving-cert\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013389    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-oauth-config\") pod \"cca212a5-762b-4712-a14a-f14b08a777e0\" (UID: \"cca212a5-762b-4712-a14a-f14b08a777e0\") "
Jul 24 01:33:37.013575 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013521    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:37.013628 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013562    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:37.013818 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013795    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-trusted-ca-bundle\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.013818 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013820    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.014002 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013811    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-console-config" (OuterVolumeSpecName: "console-config") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:37.014002 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.013814    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:33:37.015468 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.015439    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:33:37.015468 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.015446    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca212a5-762b-4712-a14a-f14b08a777e0-kube-api-access-xmnbw" (OuterVolumeSpecName: "kube-api-access-xmnbw") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "kube-api-access-xmnbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:33:37.015587 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.015498    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cca212a5-762b-4712-a14a-f14b08a777e0" (UID: "cca212a5-762b-4712-a14a-f14b08a777e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:33:37.115163 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.115129    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmnbw\" (UniqueName: \"kubernetes.io/projected/cca212a5-762b-4712-a14a-f14b08a777e0-kube-api-access-xmnbw\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.115163 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.115155    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.115163 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.115164    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-console-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.115163 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.115172    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca212a5-762b-4712-a14a-f14b08a777e0-oauth-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.115437 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.115205    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca212a5-762b-4712-a14a-f14b08a777e0-console-oauth-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:33:37.622145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.622114    2568 generic.go:356] "Generic (PLEG): container finished" podID="cca212a5-762b-4712-a14a-f14b08a777e0" containerID="48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007" exitCode=0
Jul 24 01:33:37.622516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.622164    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d666c4ffd-4sqpj"
Jul 24 01:33:37.622516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.622204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d666c4ffd-4sqpj" event={"ID":"cca212a5-762b-4712-a14a-f14b08a777e0","Type":"ContainerDied","Data":"48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007"}
Jul 24 01:33:37.622516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.622262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d666c4ffd-4sqpj" event={"ID":"cca212a5-762b-4712-a14a-f14b08a777e0","Type":"ContainerDied","Data":"b4ee79d2c6ada79111dce24e50f36e924597599fa708338dbeab1b6b5f577f1a"}
Jul 24 01:33:37.622516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.622290    2568 scope.go:117] "RemoveContainer" containerID="48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007"
Jul 24 01:33:37.630308 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.630292    2568 scope.go:117] "RemoveContainer" containerID="48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007"
Jul 24 01:33:37.630539 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:33:37.630524    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007\": container with ID starting with 48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007 not found: ID does not exist" containerID="48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007"
Jul 24 01:33:37.630588 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.630546    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007"} err="failed to get container status \"48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007\": rpc error: code = NotFound desc = could not find container \"48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007\": container with ID starting with 48279d9503e5ddd0beac00863d25dea64dc8c6e6c3cb28ffc65cc5bdaf3fa007 not found: ID does not exist"
Jul 24 01:33:37.637538 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.637466    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d666c4ffd-4sqpj"]
Jul 24 01:33:37.639471 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:37.639452    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d666c4ffd-4sqpj"]
Jul 24 01:33:39.504456 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:39.504427    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca212a5-762b-4712-a14a-f14b08a777e0" path="/var/lib/kubelet/pods/cca212a5-762b-4712-a14a-f14b08a777e0/volumes"
Jul 24 01:33:57.597894 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:33:57.597853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:02.396200 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:02.396135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:02.497227 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:02.497188    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:29.003856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:29.003822    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:29.818265 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:29.818232    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:32.457755 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:32.457724    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:32.584266 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:32.584231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:33.483076 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:33.483041    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:33.590113 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:33.590075    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:34.537090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:34.537057    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:34.637003 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:34.636972    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:36.766137 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:36.766098    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:36.943020 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:36.942979    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:39.210526 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:39.210490    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:39.263396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:39.263359    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:41.335262 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:41.335230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:41.436970 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:41.436933    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:42.849300 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:42.849268    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:42.950414 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:42.950363    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:44.967647 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:44.967615    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:47.414393 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:47.414367    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 01:34:48.844144 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:48.844106    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:48.944057 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:48.944023    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:34:51.199251 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:34:51.199216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:08.029190 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:08.029112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:08.148704 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:08.148668    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:08.629618 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:08.629583    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:08.835121 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:08.835089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:08.950750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:08.950711    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.015747 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.015715    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"]
Jul 24 01:35:09.016035 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.016022    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca212a5-762b-4712-a14a-f14b08a777e0" containerName="console"
Jul 24 01:35:09.016090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.016036    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca212a5-762b-4712-a14a-f14b08a777e0" containerName="console"
Jul 24 01:35:09.016090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.016048    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27323087-855a-4e32-99bd-227dcfa58e41" containerName="console"
Jul 24 01:35:09.016090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.016053    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="27323087-855a-4e32-99bd-227dcfa58e41" containerName="console"
Jul 24 01:35:09.016223 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.016106    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca212a5-762b-4712-a14a-f14b08a777e0" containerName="console"
Jul 24 01:35:09.016223 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.016113    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="27323087-855a-4e32-99bd-227dcfa58e41" containerName="console"
Jul 24 01:35:09.018934 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.018919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.021829 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.021810    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 01:35:09.022450 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.022432    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 01:35:09.022543 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.022512    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 01:35:09.022721 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.022692    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 01:35:09.023029 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.023014    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ztd2k\""
Jul 24 01:35:09.041098 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.041074    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"]
Jul 24 01:35:09.096138 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.096107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6fc4bfd-544b-4994-94f0-c91ab71d831a-tmp\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.096278 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.096167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc4bfd-544b-4994-94f0-c91ab71d831a-webhook-cert\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.096278 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.096262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6fc4bfd-544b-4994-94f0-c91ab71d831a-manifests\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.096350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.096290    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6fc4bfd-544b-4994-94f0-c91ab71d831a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.096350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.096316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z56cs\" (UniqueName: \"kubernetes.io/projected/a6fc4bfd-544b-4994-94f0-c91ab71d831a-kube-api-access-z56cs\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.129015 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.128986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.197530 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.197504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc4bfd-544b-4994-94f0-c91ab71d831a-webhook-cert\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.197648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.197548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6fc4bfd-544b-4994-94f0-c91ab71d831a-manifests\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.197648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.197563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6fc4bfd-544b-4994-94f0-c91ab71d831a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.197730 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.197674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z56cs\" (UniqueName: \"kubernetes.io/projected/a6fc4bfd-544b-4994-94f0-c91ab71d831a-kube-api-access-z56cs\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.197778 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.197748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6fc4bfd-544b-4994-94f0-c91ab71d831a-tmp\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.197935 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.197914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6fc4bfd-544b-4994-94f0-c91ab71d831a-manifests\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.199897 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.199874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6fc4bfd-544b-4994-94f0-c91ab71d831a-tmp\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.199980 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.199959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc4bfd-544b-4994-94f0-c91ab71d831a-webhook-cert\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.200028 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.200012    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6fc4bfd-544b-4994-94f0-c91ab71d831a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.207482 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.207421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z56cs\" (UniqueName: \"kubernetes.io/projected/a6fc4bfd-544b-4994-94f0-c91ab71d831a-kube-api-access-z56cs\") pod \"opendatahub-operator-controller-manager-59c5678768-7jzkv\" (UID: \"a6fc4bfd-544b-4994-94f0-c91ab71d831a\") " pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.228276 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.228235    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.328803 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.328778    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:09.330034 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.329996    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.432318 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.432283    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.463527 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.463506    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"]
Jul 24 01:35:09.466053 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:35:09.466028    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6fc4bfd_544b_4994_94f0_c91ab71d831a.slice/crio-ed35ca25cfffc44d17ce3c9c7023b67bbdea719f1282fe8e77c465103998b4db WatchSource:0}: Error finding container ed35ca25cfffc44d17ce3c9c7023b67bbdea719f1282fe8e77c465103998b4db: Status 404 returned error can't find the container with id ed35ca25cfffc44d17ce3c9c7023b67bbdea719f1282fe8e77c465103998b4db
Jul 24 01:35:09.467910 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.467831    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 01:35:09.529972 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.529945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.640006 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.639977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.730340 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.730269    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:09.974541 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:09.974505    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv" event={"ID":"a6fc4bfd-544b-4994-94f0-c91ab71d831a","Type":"ContainerStarted","Data":"ed35ca25cfffc44d17ce3c9c7023b67bbdea719f1282fe8e77c465103998b4db"}
Jul 24 01:35:10.631269 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:10.631232    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:10.731832 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:10.731693    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:12.988843 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:12.988811    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv" event={"ID":"a6fc4bfd-544b-4994-94f0-c91ab71d831a","Type":"ContainerStarted","Data":"28a0f875425b8737f0768be6638b090358b78ab0aa7f39865b6b4c91cb2182b3"}
Jul 24 01:35:13.994810 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:13.994774    2568 generic.go:356] "Generic (PLEG): container finished" podID="a6fc4bfd-544b-4994-94f0-c91ab71d831a" containerID="28a0f875425b8737f0768be6638b090358b78ab0aa7f39865b6b4c91cb2182b3" exitCode=0
Jul 24 01:35:13.995212 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:13.994816    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv" event={"ID":"a6fc4bfd-544b-4994-94f0-c91ab71d831a","Type":"ContainerDied","Data":"28a0f875425b8737f0768be6638b090358b78ab0aa7f39865b6b4c91cb2182b3"}
Jul 24 01:35:15.000451 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:15.000420    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv" event={"ID":"a6fc4bfd-544b-4994-94f0-c91ab71d831a","Type":"ContainerStarted","Data":"91393448be0f3dadeb70f140c3d5dcbc1809dde6db1a740dfd7d6e1b5d912e9d"}
Jul 24 01:35:15.000868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:15.000552    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:15.020991 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:15.020943    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv" podStartSLOduration=2.568967046 podStartE2EDuration="7.020926901s" totalImagesPullingTime="3.421073662s" totalInitContainerRuntime="1.030886193s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:35:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:35:15.018921978 +0000 UTC m=+328.043320480" watchObservedRunningTime="2026-07-24 01:35:15.020926901 +0000 UTC m=+328.045325378"
Jul 24 01:35:17.448105 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:17.448070    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:17.548341 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:17.548312    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:20.828107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:20.828072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:20.925196 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:20.925156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:23.567108 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:23.567077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:23.990330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:23.990302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:24.041453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:24.041428    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:26.007263 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:26.007232    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59c5678768-7jzkv"
Jul 24 01:35:27.940434 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:27.940397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:28.059627 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:28.059599    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:28.533416 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:28.533382    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:28.793768 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:28.793691    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:28.935318 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:28.935282    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:29.042535 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:29.042497    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:29.148808 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:29.148726    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:29.256031 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:29.255997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:29.363201 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:29.363125    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:29.702419 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:29.702386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:29.795382 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:29.795346    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:30.206285 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:30.206258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:30.695565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:30.695533    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:33.847409 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:33.847373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:33.951693 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:33.951664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:34.527715 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.527684    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"]
Jul 24 01:35:34.543044 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.543019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.545765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.545737    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 01:35:34.545765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.545747    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z8452\""
Jul 24 01:35:34.546731 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.546706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"]
Jul 24 01:35:34.574912 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.574886    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:34.625903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.625869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626057 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.625924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626057 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626057 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcv7m\" (UniqueName: \"kubernetes.io/projected/33678dd4-101f-4b6d-85ee-79243359d198-kube-api-access-lcv7m\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626190 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33678dd4-101f-4b6d-85ee-79243359d198-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626190 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626190 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33678dd4-101f-4b6d-85ee-79243359d198-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626317 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33678dd4-101f-4b6d-85ee-79243359d198-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.626317 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.626242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.677344 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.677311    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:34.726887 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.726852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.726904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.726922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcv7m\" (UniqueName: \"kubernetes.io/projected/33678dd4-101f-4b6d-85ee-79243359d198-kube-api-access-lcv7m\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.726943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33678dd4-101f-4b6d-85ee-79243359d198-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.726961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.726978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33678dd4-101f-4b6d-85ee-79243359d198-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33678dd4-101f-4b6d-85ee-79243359d198-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727051 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727417 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727417 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727338    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727417 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727354    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727570 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727422    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727673 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.727774 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.727756    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33678dd4-101f-4b6d-85ee-79243359d198-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.729288 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.729268    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33678dd4-101f-4b6d-85ee-79243359d198-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.729422 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.729407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33678dd4-101f-4b6d-85ee-79243359d198-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.735403 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.735379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33678dd4-101f-4b6d-85ee-79243359d198-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.736389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.736365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcv7m\" (UniqueName: \"kubernetes.io/projected/33678dd4-101f-4b6d-85ee-79243359d198-kube-api-access-lcv7m\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chv56t\" (UID: \"33678dd4-101f-4b6d-85ee-79243359d198\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.857340 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.857259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:34.868997 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.868972    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:34.988210 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:34.988142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"]
Jul 24 01:35:34.990497 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:35:34.990468    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33678dd4_101f_4b6d_85ee_79243359d198.slice/crio-96bc7f839c5890291c1c00570f6d072af7d9dfcafe064dbbb42e74278543261a WatchSource:0}: Error finding container 96bc7f839c5890291c1c00570f6d072af7d9dfcafe064dbbb42e74278543261a: Status 404 returned error can't find the container with id 96bc7f839c5890291c1c00570f6d072af7d9dfcafe064dbbb42e74278543261a
Jul 24 01:35:35.094111 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:35.094069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t" event={"ID":"33678dd4-101f-4b6d-85ee-79243359d198","Type":"ContainerStarted","Data":"96bc7f839c5890291c1c00570f6d072af7d9dfcafe064dbbb42e74278543261a"}
Jul 24 01:35:35.275310 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:35.275270    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:37.025709 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.025680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:37.127025 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.126989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:37.637045 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.637010    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"]
Jul 24 01:35:37.642559 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.642534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.648614 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.648589    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 01:35:37.648917 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.648896    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 01:35:37.649018 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.648956    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 01:35:37.649871 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.649839    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 01:35:37.653367 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.653345    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qlfv9\""
Jul 24 01:35:37.656345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.656326    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 01:35:37.679655 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.679625    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"]
Jul 24 01:35:37.761347 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.761296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44060b5b-12c7-425e-af2c-8a8cfe9bba43-manager-config\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.761541 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.761444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44060b5b-12c7-425e-af2c-8a8cfe9bba43-metrics-cert\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.761541 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.761484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b48h\" (UniqueName: \"kubernetes.io/projected/44060b5b-12c7-425e-af2c-8a8cfe9bba43-kube-api-access-6b48h\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.761541 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.761520    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44060b5b-12c7-425e-af2c-8a8cfe9bba43-cert\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.863099 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.863059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44060b5b-12c7-425e-af2c-8a8cfe9bba43-metrics-cert\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.863296 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.863118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b48h\" (UniqueName: \"kubernetes.io/projected/44060b5b-12c7-425e-af2c-8a8cfe9bba43-kube-api-access-6b48h\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.863352 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.863298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44060b5b-12c7-425e-af2c-8a8cfe9bba43-cert\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.863407 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.863376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44060b5b-12c7-425e-af2c-8a8cfe9bba43-manager-config\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.864053 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.864027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/44060b5b-12c7-425e-af2c-8a8cfe9bba43-manager-config\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.865922 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.865896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/44060b5b-12c7-425e-af2c-8a8cfe9bba43-metrics-cert\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.866031 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.865932    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44060b5b-12c7-425e-af2c-8a8cfe9bba43-cert\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.872911 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.872885    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b48h\" (UniqueName: \"kubernetes.io/projected/44060b5b-12c7-425e-af2c-8a8cfe9bba43-kube-api-access-6b48h\") pod \"lws-controller-manager-745f9c9fb8-gl82x\" (UID: \"44060b5b-12c7-425e-af2c-8a8cfe9bba43\") " pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:37.954851 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:37.954811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:38.006543 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.006507    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:35:38.006677 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.006594    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:35:38.006677 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.006647    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:35:38.111497 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.111454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t" event={"ID":"33678dd4-101f-4b6d-85ee-79243359d198","Type":"ContainerStarted","Data":"8edd7f6e31b7e5adbb4990af5b82ce34cedbacb06f45000e18519736d6c8d0d1"}
Jul 24 01:35:38.151724 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.151692    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"]
Jul 24 01:35:38.151841 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:35:38.151769    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44060b5b_12c7_425e_af2c_8a8cfe9bba43.slice/crio-e53d8e2dd7149c13cd43804be3d39a70fe2941a0ceae64796e600c5fabe10bef WatchSource:0}: Error finding container e53d8e2dd7149c13cd43804be3d39a70fe2941a0ceae64796e600c5fabe10bef: Status 404 returned error can't find the container with id e53d8e2dd7149c13cd43804be3d39a70fe2941a0ceae64796e600c5fabe10bef
Jul 24 01:35:38.202348 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.202284    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t" podStartSLOduration=1.188552487 podStartE2EDuration="4.20226341s" totalImagesPullingTime="3.013710923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:35:38.196652438 +0000 UTC m=+351.221050916" watchObservedRunningTime="2026-07-24 01:35:38.20226341 +0000 UTC m=+351.226661889"
Jul 24 01:35:38.464615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.464581    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:38.517661 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.517631    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-k577l"]
Jul 24 01:35:38.520061 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.520046    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.522472 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.522450    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 01:35:38.522597 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.522455    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-d6hqr\""
Jul 24 01:35:38.533056 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.533035    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-k577l"]
Jul 24 01:35:38.560096 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.560059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:38.637983 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.637942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:38.671198 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.671152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b213e83b-ff93-4261-a5a1-b3a1c5a482e7-cert\") pod \"kserve-controller-manager-d6f4b65b8-k577l\" (UID: \"b213e83b-ff93-4261-a5a1-b3a1c5a482e7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.671327 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.671253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw8zl\" (UniqueName: \"kubernetes.io/projected/b213e83b-ff93-4261-a5a1-b3a1c5a482e7-kube-api-access-fw8zl\") pod \"kserve-controller-manager-d6f4b65b8-k577l\" (UID: \"b213e83b-ff93-4261-a5a1-b3a1c5a482e7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.772536 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.772453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw8zl\" (UniqueName: \"kubernetes.io/projected/b213e83b-ff93-4261-a5a1-b3a1c5a482e7-kube-api-access-fw8zl\") pod \"kserve-controller-manager-d6f4b65b8-k577l\" (UID: \"b213e83b-ff93-4261-a5a1-b3a1c5a482e7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.772684 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.772560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b213e83b-ff93-4261-a5a1-b3a1c5a482e7-cert\") pod \"kserve-controller-manager-d6f4b65b8-k577l\" (UID: \"b213e83b-ff93-4261-a5a1-b3a1c5a482e7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.774939 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.774921    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b213e83b-ff93-4261-a5a1-b3a1c5a482e7-cert\") pod \"kserve-controller-manager-d6f4b65b8-k577l\" (UID: \"b213e83b-ff93-4261-a5a1-b3a1c5a482e7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.789045 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.789023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw8zl\" (UniqueName: \"kubernetes.io/projected/b213e83b-ff93-4261-a5a1-b3a1c5a482e7-kube-api-access-fw8zl\") pod \"kserve-controller-manager-d6f4b65b8-k577l\" (UID: \"b213e83b-ff93-4261-a5a1-b3a1c5a482e7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.830977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.830942    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:38.858358 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.858326    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:38.916412 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.916355    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:38.991674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:38.991645    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-k577l"]
Jul 24 01:35:38.995438 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:35:38.995300    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb213e83b_ff93_4261_a5a1_b3a1c5a482e7.slice/crio-62fc4a32cb19e46d1477e658309f3a741e91edb03ef4d13b3b545affbd76ca80 WatchSource:0}: Error finding container 62fc4a32cb19e46d1477e658309f3a741e91edb03ef4d13b3b545affbd76ca80: Status 404 returned error can't find the container with id 62fc4a32cb19e46d1477e658309f3a741e91edb03ef4d13b3b545affbd76ca80
Jul 24 01:35:39.118943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:39.118850    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x" event={"ID":"44060b5b-12c7-425e-af2c-8a8cfe9bba43","Type":"ContainerStarted","Data":"e53d8e2dd7149c13cd43804be3d39a70fe2941a0ceae64796e600c5fabe10bef"}
Jul 24 01:35:39.120201 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:39.120155    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l" event={"ID":"b213e83b-ff93-4261-a5a1-b3a1c5a482e7","Type":"ContainerStarted","Data":"62fc4a32cb19e46d1477e658309f3a741e91edb03ef4d13b3b545affbd76ca80"}
Jul 24 01:35:39.712262 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:39.712217    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:39.814960 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:39.814921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:39.862948 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:39.862922    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:39.926283 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:39.926249    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:40.125917 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:40.125797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:40.127274 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:40.127253    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chv56t"
Jul 24 01:35:41.132917 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:41.132837    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x" event={"ID":"44060b5b-12c7-425e-af2c-8a8cfe9bba43","Type":"ContainerStarted","Data":"244d9a7f88378daf0b8f40727f2f743872c822f98fc74c2ed54936bda241667b"}
Jul 24 01:35:41.132917 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:41.132914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:35:41.151378 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:41.151334    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x" podStartSLOduration=1.605259573 podStartE2EDuration="4.15131937s" totalImagesPullingTime="2.546059797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:35:41.149434031 +0000 UTC m=+354.173832510" watchObservedRunningTime="2026-07-24 01:35:41.15131937 +0000 UTC m=+354.175717905"
Jul 24 01:35:42.480093 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:42.480054    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:42.553682 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:42.553633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:43.144674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:43.144640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l" event={"ID":"b213e83b-ff93-4261-a5a1-b3a1c5a482e7","Type":"ContainerStarted","Data":"c863b0ec2ce743b1f9a901d71834a7cbada1c99c9825b9696eb301ff915798cd"}
Jul 24 01:35:43.144846 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:43.144758    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:35:43.161589 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:43.161540    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l" podStartSLOduration=1.819991455 podStartE2EDuration="5.161525346s" totalImagesPullingTime="3.341533891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:35:43.160151392 +0000 UTC m=+356.184549869" watchObservedRunningTime="2026-07-24 01:35:43.161525346 +0000 UTC m=+356.185923865"
Jul 24 01:35:48.448799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:48.448764    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:48.535069 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:48.535029    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:35:52.140891 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:35:52.140862    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-745f9c9fb8-gl82x"
Jul 24 01:36:04.027027 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:04.026990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:36:14.155548 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:14.155516    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-k577l"
Jul 24 01:36:29.436740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.436705    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:36:29.540569 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.540527    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:36:29.650312 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.650276    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zz7w"]
Jul 24 01:36:29.657600 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.657576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:29.660720 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.660692    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-trlrn\""
Jul 24 01:36:29.660981 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.660964    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 01:36:29.661601 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.661462    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zz7w"]
Jul 24 01:36:29.662082 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.662061    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 01:36:29.693805 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.693782    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:36:29.821009 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.820978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpsxp\" (UniqueName: \"kubernetes.io/projected/2e51effd-36bf-4ab9-8736-cc8513de3eef-kube-api-access-kpsxp\") pod \"kuadrant-operator-catalog-9zz7w\" (UID: \"2e51effd-36bf-4ab9-8736-cc8513de3eef\") " pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:29.922587 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.922550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpsxp\" (UniqueName: \"kubernetes.io/projected/2e51effd-36bf-4ab9-8736-cc8513de3eef-kube-api-access-kpsxp\") pod \"kuadrant-operator-catalog-9zz7w\" (UID: \"2e51effd-36bf-4ab9-8736-cc8513de3eef\") " pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:29.930094 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.930073    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpsxp\" (UniqueName: \"kubernetes.io/projected/2e51effd-36bf-4ab9-8736-cc8513de3eef-kube-api-access-kpsxp\") pod \"kuadrant-operator-catalog-9zz7w\" (UID: \"2e51effd-36bf-4ab9-8736-cc8513de3eef\") " pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:29.969194 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:29.969101    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:30.023713 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.023686    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zz7w"]
Jul 24 01:36:30.095285 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.095264    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zz7w"]
Jul 24 01:36:30.097797 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:36:30.097764    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e51effd_36bf_4ab9_8736_cc8513de3eef.slice/crio-1eecf4861bd135f949e61828875975891013c43317fdf02dcbcc7e045da35f71 WatchSource:0}: Error finding container 1eecf4861bd135f949e61828875975891013c43317fdf02dcbcc7e045da35f71: Status 404 returned error can't find the container with id 1eecf4861bd135f949e61828875975891013c43317fdf02dcbcc7e045da35f71
Jul 24 01:36:30.237732 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.237651    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngcgz"]
Jul 24 01:36:30.240613 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.240598    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:30.249114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.249090    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngcgz"]
Jul 24 01:36:30.326140 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.326108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm78q\" (UniqueName: \"kubernetes.io/projected/520a90c1-af5d-4221-bf33-80d5f8675817-kube-api-access-lm78q\") pod \"kuadrant-operator-catalog-ngcgz\" (UID: \"520a90c1-af5d-4221-bf33-80d5f8675817\") " pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:30.346356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.346324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w" event={"ID":"2e51effd-36bf-4ab9-8736-cc8513de3eef","Type":"ContainerStarted","Data":"1eecf4861bd135f949e61828875975891013c43317fdf02dcbcc7e045da35f71"}
Jul 24 01:36:30.427806 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.427772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm78q\" (UniqueName: \"kubernetes.io/projected/520a90c1-af5d-4221-bf33-80d5f8675817-kube-api-access-lm78q\") pod \"kuadrant-operator-catalog-ngcgz\" (UID: \"520a90c1-af5d-4221-bf33-80d5f8675817\") " pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:30.435736 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.435709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm78q\" (UniqueName: \"kubernetes.io/projected/520a90c1-af5d-4221-bf33-80d5f8675817-kube-api-access-lm78q\") pod \"kuadrant-operator-catalog-ngcgz\" (UID: \"520a90c1-af5d-4221-bf33-80d5f8675817\") " pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:30.463669 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.463637    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:36:30.550548 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.550469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:30.664616 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.664463    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:36:30.691063 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:30.691037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngcgz"]
Jul 24 01:36:30.694688 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:36:30.694651    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520a90c1_af5d_4221_bf33_80d5f8675817.slice/crio-1b67c085cc0022e753391339d06846875098b870b591169073d26f7ffcf719f1 WatchSource:0}: Error finding container 1b67c085cc0022e753391339d06846875098b870b591169073d26f7ffcf719f1: Status 404 returned error can't find the container with id 1b67c085cc0022e753391339d06846875098b870b591169073d26f7ffcf719f1
Jul 24 01:36:31.353753 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:31.353714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz" event={"ID":"520a90c1-af5d-4221-bf33-80d5f8675817","Type":"ContainerStarted","Data":"1b67c085cc0022e753391339d06846875098b870b591169073d26f7ffcf719f1"}
Jul 24 01:36:32.360148 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.360095    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz" event={"ID":"520a90c1-af5d-4221-bf33-80d5f8675817","Type":"ContainerStarted","Data":"2ed7087b2c78a968aafcfd39c6bdff5aa2f8aa2ef82550d2333a5189210bc6b7"}
Jul 24 01:36:32.361597 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.361567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w" event={"ID":"2e51effd-36bf-4ab9-8736-cc8513de3eef","Type":"ContainerStarted","Data":"d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b"}
Jul 24 01:36:32.361714 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.361658    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w" podUID="2e51effd-36bf-4ab9-8736-cc8513de3eef" containerName="registry-server" containerID="cri-o://d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b" gracePeriod=2
Jul 24 01:36:32.375806 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.375765    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz" podStartSLOduration=0.936618048 podStartE2EDuration="2.375746107s" totalImagesPullingTime="1.439128059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:36:32.373429255 +0000 UTC m=+405.397827733" watchObservedRunningTime="2026-07-24 01:36:32.375746107 +0000 UTC m=+405.400144562"
Jul 24 01:36:32.387491 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.387453    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w" podStartSLOduration=1.354284332 podStartE2EDuration="3.387439295s" totalImagesPullingTime="2.033154963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:36:32.386851814 +0000 UTC m=+405.411250302" watchObservedRunningTime="2026-07-24 01:36:32.387439295 +0000 UTC m=+405.411837772"
Jul 24 01:36:32.599875 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.599852    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:32.751380 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.751334    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpsxp\" (UniqueName: \"kubernetes.io/projected/2e51effd-36bf-4ab9-8736-cc8513de3eef-kube-api-access-kpsxp\") pod \"2e51effd-36bf-4ab9-8736-cc8513de3eef\" (UID: \"2e51effd-36bf-4ab9-8736-cc8513de3eef\") "
Jul 24 01:36:32.753500 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.753478    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e51effd-36bf-4ab9-8736-cc8513de3eef-kube-api-access-kpsxp" (OuterVolumeSpecName: "kube-api-access-kpsxp") pod "2e51effd-36bf-4ab9-8736-cc8513de3eef" (UID: "2e51effd-36bf-4ab9-8736-cc8513de3eef"). InnerVolumeSpecName "kube-api-access-kpsxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:36:32.852926 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:32.852888    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpsxp\" (UniqueName: \"kubernetes.io/projected/2e51effd-36bf-4ab9-8736-cc8513de3eef-kube-api-access-kpsxp\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:36:33.367080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.367047    2568 generic.go:356] "Generic (PLEG): container finished" podID="2e51effd-36bf-4ab9-8736-cc8513de3eef" containerID="d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b" exitCode=0
Jul 24 01:36:33.367555 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.367092    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w"
Jul 24 01:36:33.367555 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.367135    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w" event={"ID":"2e51effd-36bf-4ab9-8736-cc8513de3eef","Type":"ContainerDied","Data":"d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b"}
Jul 24 01:36:33.367555 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.367207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zz7w" event={"ID":"2e51effd-36bf-4ab9-8736-cc8513de3eef","Type":"ContainerDied","Data":"1eecf4861bd135f949e61828875975891013c43317fdf02dcbcc7e045da35f71"}
Jul 24 01:36:33.367555 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.367252    2568 scope.go:117] "RemoveContainer" containerID="d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b"
Jul 24 01:36:33.376530 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.376515    2568 scope.go:117] "RemoveContainer" containerID="d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b"
Jul 24 01:36:33.376772 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:36:33.376755    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b\": container with ID starting with d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b not found: ID does not exist" containerID="d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b"
Jul 24 01:36:33.376833 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.376780    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b"} err="failed to get container status \"d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b\": rpc error: code = NotFound desc = could not find container \"d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b\": container with ID starting with d0535a257e921db50fb8ca8074ea0c7a5c8f8599f6e1451a816bc6762dfff79b not found: ID does not exist"
Jul 24 01:36:33.387314 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.387294    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zz7w"]
Jul 24 01:36:33.390751 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.390726    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zz7w"]
Jul 24 01:36:33.505282 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:33.505244    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e51effd-36bf-4ab9-8736-cc8513de3eef" path="/var/lib/kubelet/pods/2e51effd-36bf-4ab9-8736-cc8513de3eef/volumes"
Jul 24 01:36:40.551149 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:40.551110    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:40.551642 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:40.551170    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:40.571919 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:40.571893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:41.422630 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:41.422589    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ngcgz"
Jul 24 01:36:59.013288 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:36:59.013256    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:01.642889 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.642855    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"]
Jul 24 01:37:01.643293 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.643226    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e51effd-36bf-4ab9-8736-cc8513de3eef" containerName="registry-server"
Jul 24 01:37:01.643293 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.643237    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e51effd-36bf-4ab9-8736-cc8513de3eef" containerName="registry-server"
Jul 24 01:37:01.643366 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.643296    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e51effd-36bf-4ab9-8736-cc8513de3eef" containerName="registry-server"
Jul 24 01:37:01.649274 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.649257    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:01.651802 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.651781    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l2rt4\""
Jul 24 01:37:01.651802 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.651802    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 01:37:01.656589 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.656566    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"]
Jul 24 01:37:01.714292 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.714261    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrcn\" (UniqueName: \"kubernetes.io/projected/2f25d127-9ab8-4aae-9679-a78c6a260204-kube-api-access-htrcn\") pod \"dns-operator-controller-manager-864dd78c4c-pd758\" (UID: \"2f25d127-9ab8-4aae-9679-a78c6a260204\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:01.815732 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.815693    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htrcn\" (UniqueName: \"kubernetes.io/projected/2f25d127-9ab8-4aae-9679-a78c6a260204-kube-api-access-htrcn\") pod \"dns-operator-controller-manager-864dd78c4c-pd758\" (UID: \"2f25d127-9ab8-4aae-9679-a78c6a260204\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:01.838318 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.838279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrcn\" (UniqueName: \"kubernetes.io/projected/2f25d127-9ab8-4aae-9679-a78c6a260204-kube-api-access-htrcn\") pod \"dns-operator-controller-manager-864dd78c4c-pd758\" (UID: \"2f25d127-9ab8-4aae-9679-a78c6a260204\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:01.959966 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:01.959940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:02.089956 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:02.089931    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"]
Jul 24 01:37:02.092596 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:02.092562    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f25d127_9ab8_4aae_9679_a78c6a260204.slice/crio-a4e581d4f5e27326f66ebb790d4647f44e5f124b962954113c69038d07b77412 WatchSource:0}: Error finding container a4e581d4f5e27326f66ebb790d4647f44e5f124b962954113c69038d07b77412: Status 404 returned error can't find the container with id a4e581d4f5e27326f66ebb790d4647f44e5f124b962954113c69038d07b77412
Jul 24 01:37:02.493432 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:02.493399    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758" event={"ID":"2f25d127-9ab8-4aae-9679-a78c6a260204","Type":"ContainerStarted","Data":"a4e581d4f5e27326f66ebb790d4647f44e5f124b962954113c69038d07b77412"}
Jul 24 01:37:02.598787 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:02.598749    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:04.502899 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:04.502865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758" event={"ID":"2f25d127-9ab8-4aae-9679-a78c6a260204","Type":"ContainerStarted","Data":"a747a59cd29030c50462e3b0dfd5d9156dc8cffdd312eb3ea0c0cf5b943f5ca5"}
Jul 24 01:37:04.503311 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:04.502999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:04.519153 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:04.519111    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758" podStartSLOduration=1.243184747 podStartE2EDuration="3.519097789s" totalImagesPullingTime="2.275913042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:04.517028776 +0000 UTC m=+437.541427253" watchObservedRunningTime="2026-07-24 01:37:04.519097789 +0000 UTC m=+437.543496266"
Jul 24 01:37:05.633977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:05.633946    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:06.609946 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.609914    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"]
Jul 24 01:37:06.615192 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.615157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.617886 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.617870    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zkr7f\""
Jul 24 01:37:06.632574 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.632553    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"]
Jul 24 01:37:06.761981 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.761951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k64p8\" (UniqueName: \"kubernetes.io/projected/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-kube-api-access-k64p8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.762369 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.762011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.863167 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.863079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k64p8\" (UniqueName: \"kubernetes.io/projected/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-kube-api-access-k64p8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.863167 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.863138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.863487 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.863469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.883748 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.883724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k64p8\" (UniqueName: \"kubernetes.io/projected/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-kube-api-access-k64p8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:06.925660 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:06.925634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:07.060802 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:07.060770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:07.070196 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:07.070156    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"]
Jul 24 01:37:07.071960 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:07.071931    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8d201a_ec3c_4d2d_a0bf_141170b6ee12.slice/crio-eb3bb876680055167743ee5dcf1c2e528689c148fee93bb43c9fe433c6ff67b3 WatchSource:0}: Error finding container eb3bb876680055167743ee5dcf1c2e528689c148fee93bb43c9fe433c6ff67b3: Status 404 returned error can't find the container with id eb3bb876680055167743ee5dcf1c2e528689c148fee93bb43c9fe433c6ff67b3
Jul 24 01:37:07.209973 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:07.209923    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:07.516410 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:07.516330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n" event={"ID":"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12","Type":"ContainerStarted","Data":"eb3bb876680055167743ee5dcf1c2e528689c148fee93bb43c9fe433c6ff67b3"}
Jul 24 01:37:07.812150 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:07.812059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:10.484100 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:10.484016    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:11.408080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:11.402949    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:13.216145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.216108    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"]
Jul 24 01:37:13.219637 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.219621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:13.222061 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.222044    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xhkd5\""
Jul 24 01:37:13.230249 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.230221    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"]
Jul 24 01:37:13.256489 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.256461    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:13.331743 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.331705    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdkm8\" (UniqueName: \"kubernetes.io/projected/5d00e685-1155-44c8-999d-e5e662cef5cf-kube-api-access-cdkm8\") pod \"limitador-operator-controller-manager-859d7b78bd-fc46x\" (UID: \"5d00e685-1155-44c8-999d-e5e662cef5cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:13.433167 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.433130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdkm8\" (UniqueName: \"kubernetes.io/projected/5d00e685-1155-44c8-999d-e5e662cef5cf-kube-api-access-cdkm8\") pod \"limitador-operator-controller-manager-859d7b78bd-fc46x\" (UID: \"5d00e685-1155-44c8-999d-e5e662cef5cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:13.440745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.440721    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdkm8\" (UniqueName: \"kubernetes.io/projected/5d00e685-1155-44c8-999d-e5e662cef5cf-kube-api-access-cdkm8\") pod \"limitador-operator-controller-manager-859d7b78bd-fc46x\" (UID: \"5d00e685-1155-44c8-999d-e5e662cef5cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:13.534029 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.533948    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:13.550991 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.550960    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n" event={"ID":"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12","Type":"ContainerStarted","Data":"2ca7299a1fbd16a4b9686fdbd9bc27b8c211b0977fcc6b673f42710b7f64045a"}
Jul 24 01:37:13.551221 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.551203    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:13.568938 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.568893    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n" podStartSLOduration=1.8097908139999999 podStartE2EDuration="7.568878874s" totalImagesPullingTime="5.75908806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:13.5674004 +0000 UTC m=+446.591798876" watchObservedRunningTime="2026-07-24 01:37:13.568878874 +0000 UTC m=+446.593277361"
Jul 24 01:37:13.692578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:13.692548    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"]
Jul 24 01:37:13.693644 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:13.693619    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d00e685_1155_44c8_999d_e5e662cef5cf.slice/crio-7737f2a2c725575b27a5209acb6f6f5a35b237bee5e4c50dc30de87d7be36755 WatchSource:0}: Error finding container 7737f2a2c725575b27a5209acb6f6f5a35b237bee5e4c50dc30de87d7be36755: Status 404 returned error can't find the container with id 7737f2a2c725575b27a5209acb6f6f5a35b237bee5e4c50dc30de87d7be36755
Jul 24 01:37:14.558362 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:14.558318    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x" event={"ID":"5d00e685-1155-44c8-999d-e5e662cef5cf","Type":"ContainerStarted","Data":"7737f2a2c725575b27a5209acb6f6f5a35b237bee5e4c50dc30de87d7be36755"}
Jul 24 01:37:14.814774 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:14.814697    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:14.915464 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:14.915433    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:15.510368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:15.510292    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pd758"
Jul 24 01:37:15.564774 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:15.564733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x" event={"ID":"5d00e685-1155-44c8-999d-e5e662cef5cf","Type":"ContainerStarted","Data":"6b284b7fdcc3f714123165bfc089922a044e7965215d42d0dbcbabd124be4a9d"}
Jul 24 01:37:15.565330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:15.564807    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:15.586404 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:15.586358    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x" podStartSLOduration=1.036228272 podStartE2EDuration="2.586338529s" totalImagesPullingTime="1.550110257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:15.585028798 +0000 UTC m=+448.609427288" watchObservedRunningTime="2026-07-24 01:37:15.586338529 +0000 UTC m=+448.610737006"
Jul 24 01:37:15.762525 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:15.762444    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:16.196405 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:16.191701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:18.404941 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:18.404912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:18.467071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:18.467038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:24.561241 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:24.561209    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.447369 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.447331    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"]
Jul 24 01:37:26.447859 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.447517    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" containerName="manager" containerID="cri-o://2ca7299a1fbd16a4b9686fdbd9bc27b8c211b0977fcc6b673f42710b7f64045a" gracePeriod=2
Jul 24 01:37:26.460046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.460017    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"]
Jul 24 01:37:26.469759 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.469721    2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8b85n\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.473094 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.473069    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"]
Jul 24 01:37:26.473693 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.473674    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" containerName="manager"
Jul 24 01:37:26.473777 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.473697    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" containerName="manager"
Jul 24 01:37:26.473882 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.473865    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" containerName="manager"
Jul 24 01:37:26.477300 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.477268    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.479248 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.479225    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"]
Jul 24 01:37:26.479422 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.479395    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" containerName="manager" containerID="cri-o://6b284b7fdcc3f714123165bfc089922a044e7965215d42d0dbcbabd124be4a9d" gracePeriod=2
Jul 24 01:37:26.481734 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.481713    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:26.489087 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.489067    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"]
Jul 24 01:37:26.490714 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.490694    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"]
Jul 24 01:37:26.502310 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.502281    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.504399 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.504365    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fc46x\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:26.505806 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.505788    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"]
Jul 24 01:37:26.506915 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.506202    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" containerName="manager"
Jul 24 01:37:26.506915 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.506221    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" containerName="manager"
Jul 24 01:37:26.506915 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.506295    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.506915 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.506344    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" containerName="manager"
Jul 24 01:37:26.509543 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.509528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:26.511758 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.511735    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fc46x\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:26.521075 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.521051    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"]
Jul 24 01:37:26.550054 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.550023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7cn\" (UniqueName: \"kubernetes.io/projected/6de0a039-69eb-4e42-aab8-8df8c4d4c63f-kube-api-access-pr7cn\") pod \"limitador-operator-controller-manager-859d7b78bd-vz74f\" (UID: \"6de0a039-69eb-4e42-aab8-8df8c4d4c63f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:26.550199 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.550108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ed50315-51e6-4b9e-97bb-9070c4282197-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnhw7\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.550199 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.550146    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjz6k\" (UniqueName: \"kubernetes.io/projected/8ed50315-51e6-4b9e-97bb-9070c4282197-kube-api-access-xjz6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnhw7\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.551934 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.551909    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.615405 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.615363    2568 generic.go:356] "Generic (PLEG): container finished" podID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" containerID="2ca7299a1fbd16a4b9686fdbd9bc27b8c211b0977fcc6b673f42710b7f64045a" exitCode=0
Jul 24 01:37:26.617079 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.617047    2568 generic.go:356] "Generic (PLEG): container finished" podID="5d00e685-1155-44c8-999d-e5e662cef5cf" containerID="6b284b7fdcc3f714123165bfc089922a044e7965215d42d0dbcbabd124be4a9d" exitCode=0
Jul 24 01:37:26.651236 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.650993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7cn\" (UniqueName: \"kubernetes.io/projected/6de0a039-69eb-4e42-aab8-8df8c4d4c63f-kube-api-access-pr7cn\") pod \"limitador-operator-controller-manager-859d7b78bd-vz74f\" (UID: \"6de0a039-69eb-4e42-aab8-8df8c4d4c63f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:26.651236 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.651036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ed50315-51e6-4b9e-97bb-9070c4282197-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnhw7\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.651236 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.651068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjz6k\" (UniqueName: \"kubernetes.io/projected/8ed50315-51e6-4b9e-97bb-9070c4282197-kube-api-access-xjz6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnhw7\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.651604 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.651573    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ed50315-51e6-4b9e-97bb-9070c4282197-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnhw7\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.660097 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.660069    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjz6k\" (UniqueName: \"kubernetes.io/projected/8ed50315-51e6-4b9e-97bb-9070c4282197-kube-api-access-xjz6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hnhw7\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.660710 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.660690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7cn\" (UniqueName: \"kubernetes.io/projected/6de0a039-69eb-4e42-aab8-8df8c4d4c63f-kube-api-access-pr7cn\") pod \"limitador-operator-controller-manager-859d7b78bd-vz74f\" (UID: \"6de0a039-69eb-4e42-aab8-8df8c4d4c63f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:26.716896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.716877    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.718845 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.718830    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:26.719408 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.719384    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fc46x\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:26.721527 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.721507    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.723613 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.723595    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:26.725316 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:26.725293    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fc46x\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:26.752320 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.752293    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdkm8\" (UniqueName: \"kubernetes.io/projected/5d00e685-1155-44c8-999d-e5e662cef5cf-kube-api-access-cdkm8\") pod \"5d00e685-1155-44c8-999d-e5e662cef5cf\" (UID: \"5d00e685-1155-44c8-999d-e5e662cef5cf\") "
Jul 24 01:37:26.752443 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.752335    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k64p8\" (UniqueName: \"kubernetes.io/projected/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-kube-api-access-k64p8\") pod \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") "
Jul 24 01:37:26.752443 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.752410    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-extensions-socket-volume\") pod \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\" (UID: \"1c8d201a-ec3c-4d2d-a0bf-141170b6ee12\") "
Jul 24 01:37:26.752861 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.752840    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" (UID: "1c8d201a-ec3c-4d2d-a0bf-141170b6ee12"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:37:26.754116 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.754097    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d00e685-1155-44c8-999d-e5e662cef5cf-kube-api-access-cdkm8" (OuterVolumeSpecName: "kube-api-access-cdkm8") pod "5d00e685-1155-44c8-999d-e5e662cef5cf" (UID: "5d00e685-1155-44c8-999d-e5e662cef5cf"). InnerVolumeSpecName "kube-api-access-cdkm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:37:26.754221 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.754199    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-kube-api-access-k64p8" (OuterVolumeSpecName: "kube-api-access-k64p8") pod "1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" (UID: "1c8d201a-ec3c-4d2d-a0bf-141170b6ee12"). InnerVolumeSpecName "kube-api-access-k64p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:37:26.853639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.853603    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-extensions-socket-volume\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:37:26.853639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.853631    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdkm8\" (UniqueName: \"kubernetes.io/projected/5d00e685-1155-44c8-999d-e5e662cef5cf-kube-api-access-cdkm8\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:37:26.853639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.853644    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k64p8\" (UniqueName: \"kubernetes.io/projected/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12-kube-api-access-k64p8\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:37:26.890280 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.890251    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:26.898263 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.898232    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:26.982134 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:26.982097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:27.053470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.053445    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"]
Jul 24 01:37:27.055748 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.055725    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:27.056363 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:27.056337    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed50315_51e6_4b9e_97bb_9070c4282197.slice/crio-0c896677eb7092da2309c336be98871904baf6c3bed20d54dffd3941e3d8e6f5 WatchSource:0}: Error finding container 0c896677eb7092da2309c336be98871904baf6c3bed20d54dffd3941e3d8e6f5: Status 404 returned error can't find the container with id 0c896677eb7092da2309c336be98871904baf6c3bed20d54dffd3941e3d8e6f5
Jul 24 01:37:27.078446 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.078425    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"]
Jul 24 01:37:27.092284 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:27.092263    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de0a039_69eb_4e42_aab8_8df8c4d4c63f.slice/crio-760b3f1c010424905b4acb4b356a0d31fc589c9a510323d9ee60751a0eda0af6 WatchSource:0}: Error finding container 760b3f1c010424905b4acb4b356a0d31fc589c9a510323d9ee60751a0eda0af6: Status 404 returned error can't find the container with id 760b3f1c010424905b4acb4b356a0d31fc589c9a510323d9ee60751a0eda0af6
Jul 24 01:37:27.504127 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:27.504090    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fc46x\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:27.506131 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.506110    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" path="/var/lib/kubelet/pods/1c8d201a-ec3c-4d2d-a0bf-141170b6ee12/volumes"
Jul 24 01:37:27.506293 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:27.506270    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8b85n\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="1c8d201a-ec3c-4d2d-a0bf-141170b6ee12" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:27.506507 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.506494    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d00e685-1155-44c8-999d-e5e662cef5cf" path="/var/lib/kubelet/pods/5d00e685-1155-44c8-999d-e5e662cef5cf/volumes"
Jul 24 01:37:27.623690 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.623656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7" event={"ID":"8ed50315-51e6-4b9e-97bb-9070c4282197","Type":"ContainerStarted","Data":"f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af"}
Jul 24 01:37:27.623860 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.623708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7" event={"ID":"8ed50315-51e6-4b9e-97bb-9070c4282197","Type":"ContainerStarted","Data":"0c896677eb7092da2309c336be98871904baf6c3bed20d54dffd3941e3d8e6f5"}
Jul 24 01:37:27.623860 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.623768    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:27.625112 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.625094    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8b85n"
Jul 24 01:37:27.625112 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.625108    2568 scope.go:117] "RemoveContainer" containerID="2ca7299a1fbd16a4b9686fdbd9bc27b8c211b0977fcc6b673f42710b7f64045a"
Jul 24 01:37:27.626610 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.626582    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fc46x"
Jul 24 01:37:27.629916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.629895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f" event={"ID":"6de0a039-69eb-4e42-aab8-8df8c4d4c63f","Type":"ContainerStarted","Data":"9662f6d3b0eb126b480d83a0c8c0a5ee510b181a8ffdfc670bb22fd18cd3565f"}
Jul 24 01:37:27.630005 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.629942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f" event={"ID":"6de0a039-69eb-4e42-aab8-8df8c4d4c63f","Type":"ContainerStarted","Data":"760b3f1c010424905b4acb4b356a0d31fc589c9a510323d9ee60751a0eda0af6"}
Jul 24 01:37:27.630005 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.629972    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:27.635764 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.635747    2568 scope.go:117] "RemoveContainer" containerID="6b284b7fdcc3f714123165bfc089922a044e7965215d42d0dbcbabd124be4a9d"
Jul 24 01:37:27.647763 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.647621    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7" podStartSLOduration=1.64760577 podStartE2EDuration="1.64760577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:27.64651488 +0000 UTC m=+460.670913356" watchObservedRunningTime="2026-07-24 01:37:27.64760577 +0000 UTC m=+460.672004251"
Jul 24 01:37:27.648363 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.648332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:27.671025 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.670982    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f" podStartSLOduration=1.6709664640000002 podStartE2EDuration="1.670966464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:27.669766544 +0000 UTC m=+460.694165022" watchObservedRunningTime="2026-07-24 01:37:27.670966464 +0000 UTC m=+460.695364941"
Jul 24 01:37:27.748085 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:27.748012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:30.628511 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:30.628474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:30.728952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:30.728917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:33.221078 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:33.221043    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:33.321680 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:33.321647    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:36.815242 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:36.815196    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:36.915494 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:36.915466    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:38.640027 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:38.639999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:38.640427 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:38.640070    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vz74f"
Jul 24 01:37:43.146750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.146716    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"]
Jul 24 01:37:43.147214 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.146909    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7" podUID="8ed50315-51e6-4b9e-97bb-9070c4282197" containerName="manager" containerID="cri-o://f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af" gracePeriod=10
Jul 24 01:37:43.387718 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.387692    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"]
Jul 24 01:37:43.410880 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.410819    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"]
Jul 24 01:37:43.410991 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.410914    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.420765 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.420745    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:43.509421 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.509394    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjz6k\" (UniqueName: \"kubernetes.io/projected/8ed50315-51e6-4b9e-97bb-9070c4282197-kube-api-access-xjz6k\") pod \"8ed50315-51e6-4b9e-97bb-9070c4282197\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") "
Jul 24 01:37:43.509581 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.509465    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ed50315-51e6-4b9e-97bb-9070c4282197-extensions-socket-volume\") pod \"8ed50315-51e6-4b9e-97bb-9070c4282197\" (UID: \"8ed50315-51e6-4b9e-97bb-9070c4282197\") "
Jul 24 01:37:43.509653 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.509602    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28472e74-edc0-4627-a41d-dcba738701da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zbx7b\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.509653 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.509622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n7ml\" (UniqueName: \"kubernetes.io/projected/28472e74-edc0-4627-a41d-dcba738701da-kube-api-access-4n7ml\") pod \"kuadrant-operator-controller-manager-86878c769f-zbx7b\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.509941 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.509876    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed50315-51e6-4b9e-97bb-9070c4282197-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8ed50315-51e6-4b9e-97bb-9070c4282197" (UID: "8ed50315-51e6-4b9e-97bb-9070c4282197"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:37:43.511453 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.511435    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed50315-51e6-4b9e-97bb-9070c4282197-kube-api-access-xjz6k" (OuterVolumeSpecName: "kube-api-access-xjz6k") pod "8ed50315-51e6-4b9e-97bb-9070c4282197" (UID: "8ed50315-51e6-4b9e-97bb-9070c4282197"). InnerVolumeSpecName "kube-api-access-xjz6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:37:43.611062 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.611029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28472e74-edc0-4627-a41d-dcba738701da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zbx7b\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.611062 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.611061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n7ml\" (UniqueName: \"kubernetes.io/projected/28472e74-edc0-4627-a41d-dcba738701da-kube-api-access-4n7ml\") pod \"kuadrant-operator-controller-manager-86878c769f-zbx7b\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.611392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.611368    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjz6k\" (UniqueName: \"kubernetes.io/projected/8ed50315-51e6-4b9e-97bb-9070c4282197-kube-api-access-xjz6k\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:37:43.611468 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.611399    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ed50315-51e6-4b9e-97bb-9070c4282197-extensions-socket-volume\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:37:43.611534 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.611476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28472e74-edc0-4627-a41d-dcba738701da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zbx7b\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.621875 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.621849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n7ml\" (UniqueName: \"kubernetes.io/projected/28472e74-edc0-4627-a41d-dcba738701da-kube-api-access-4n7ml\") pod \"kuadrant-operator-controller-manager-86878c769f-zbx7b\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.712249 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.712220    2568 generic.go:356] "Generic (PLEG): container finished" podID="8ed50315-51e6-4b9e-97bb-9070c4282197" containerID="f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af" exitCode=0
Jul 24 01:37:43.712392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.712263    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"
Jul 24 01:37:43.712392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.712305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7" event={"ID":"8ed50315-51e6-4b9e-97bb-9070c4282197","Type":"ContainerDied","Data":"f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af"}
Jul 24 01:37:43.712392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.712354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7" event={"ID":"8ed50315-51e6-4b9e-97bb-9070c4282197","Type":"ContainerDied","Data":"0c896677eb7092da2309c336be98871904baf6c3bed20d54dffd3941e3d8e6f5"}
Jul 24 01:37:43.712392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.712380    2568 scope.go:117] "RemoveContainer" containerID="f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af"
Jul 24 01:37:43.720703 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.720679    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:43.721714 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.721694    2568 scope.go:117] "RemoveContainer" containerID="f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af"
Jul 24 01:37:43.721970 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:37:43.721953    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af\": container with ID starting with f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af not found: ID does not exist" containerID="f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af"
Jul 24 01:37:43.722038 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.721977    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af"} err="failed to get container status \"f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af\": rpc error: code = NotFound desc = could not find container \"f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af\": container with ID starting with f0b56dcf34bcabd52958b40a33b79c9298f47462995138512ffabca20a85c3af not found: ID does not exist"
Jul 24 01:37:43.769734 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.769711    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"]
Jul 24 01:37:43.780513 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.780487    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hnhw7"]
Jul 24 01:37:43.888530 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:43.888508    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"]
Jul 24 01:37:43.890680 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:43.890658    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28472e74_edc0_4627_a41d_dcba738701da.slice/crio-bdf69945cc06c01629e83d215e661ea3e8b419f7e4ee4669da46018c0920cfac WatchSource:0}: Error finding container bdf69945cc06c01629e83d215e661ea3e8b419f7e4ee4669da46018c0920cfac: Status 404 returned error can't find the container with id bdf69945cc06c01629e83d215e661ea3e8b419f7e4ee4669da46018c0920cfac
Jul 24 01:37:44.719000 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:44.718963    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b" event={"ID":"28472e74-edc0-4627-a41d-dcba738701da","Type":"ContainerStarted","Data":"10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c"}
Jul 24 01:37:44.719426 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:44.719013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b" event={"ID":"28472e74-edc0-4627-a41d-dcba738701da","Type":"ContainerStarted","Data":"bdf69945cc06c01629e83d215e661ea3e8b419f7e4ee4669da46018c0920cfac"}
Jul 24 01:37:44.719426 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:44.719100    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:44.742144 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:44.742094    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b" podStartSLOduration=1.742077342 podStartE2EDuration="1.742077342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:44.739447569 +0000 UTC m=+477.763846046" watchObservedRunningTime="2026-07-24 01:37:44.742077342 +0000 UTC m=+477.766475830"
Jul 24 01:37:45.504615 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:45.504583    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed50315-51e6-4b9e-97bb-9070c4282197" path="/var/lib/kubelet/pods/8ed50315-51e6-4b9e-97bb-9070c4282197/volumes"
Jul 24 01:37:46.592090 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:46.592054    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:47.026166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:47.026138    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:47.134565 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:47.134537    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:50.026854 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.026815    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:50.129072 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.129041    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:50.721667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.721634    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc6695b48-rqndt"]
Jul 24 01:37:50.721990 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.721978    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed50315-51e6-4b9e-97bb-9070c4282197" containerName="manager"
Jul 24 01:37:50.722041 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.721991    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed50315-51e6-4b9e-97bb-9070c4282197" containerName="manager"
Jul 24 01:37:50.722075 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.722070    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed50315-51e6-4b9e-97bb-9070c4282197" containerName="manager"
Jul 24 01:37:50.724890 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.724871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.735824 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.735795    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc6695b48-rqndt"]
Jul 24 01:37:50.772395 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.772370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:50.881877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.881846    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-service-ca\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.881877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.881882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-console-config\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.882114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.881915    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-oauth-serving-cert\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.882114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.882041    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-trusted-ca-bundle\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.882114 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.882076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq8kq\" (UniqueName: \"kubernetes.io/projected/335890ea-020e-421d-88ff-ba6102a0168f-kube-api-access-mq8kq\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.882311 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.882142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335890ea-020e-421d-88ff-ba6102a0168f-console-serving-cert\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.882311 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.882213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335890ea-020e-421d-88ff-ba6102a0168f-console-oauth-config\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-trusted-ca-bundle\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983425 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq8kq\" (UniqueName: \"kubernetes.io/projected/335890ea-020e-421d-88ff-ba6102a0168f-kube-api-access-mq8kq\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983639 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335890ea-020e-421d-88ff-ba6102a0168f-console-serving-cert\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983678 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335890ea-020e-421d-88ff-ba6102a0168f-console-oauth-config\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983718 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-service-ca\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983767 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-console-config\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.983882 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.983860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-oauth-serving-cert\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.984226 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.984199    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-trusted-ca-bundle\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.984341 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.984328    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-console-config\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.984455 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.984433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-service-ca\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.984510 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.984493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/335890ea-020e-421d-88ff-ba6102a0168f-oauth-serving-cert\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.986042 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.986021    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/335890ea-020e-421d-88ff-ba6102a0168f-console-oauth-config\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.986156 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.986136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/335890ea-020e-421d-88ff-ba6102a0168f-console-serving-cert\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:50.990946 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:50.990929    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq8kq\" (UniqueName: \"kubernetes.io/projected/335890ea-020e-421d-88ff-ba6102a0168f-kube-api-access-mq8kq\") pod \"console-6dc6695b48-rqndt\" (UID: \"335890ea-020e-421d-88ff-ba6102a0168f\") " pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:51.033583 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:51.033550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:37:51.164929 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:51.164906    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc6695b48-rqndt"]
Jul 24 01:37:51.167356 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:37:51.167327    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335890ea_020e_421d_88ff_ba6102a0168f.slice/crio-738fbbbf09d8bffe616b0dc00e5acfdb83ed67c8fa433517bb32ddca1272f862 WatchSource:0}: Error finding container 738fbbbf09d8bffe616b0dc00e5acfdb83ed67c8fa433517bb32ddca1272f862: Status 404 returned error can't find the container with id 738fbbbf09d8bffe616b0dc00e5acfdb83ed67c8fa433517bb32ddca1272f862
Jul 24 01:37:51.754513 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:51.754479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc6695b48-rqndt" event={"ID":"335890ea-020e-421d-88ff-ba6102a0168f","Type":"ContainerStarted","Data":"d1f1c06bae4828f6560c81f51bab46b1c8ae994430e571423c637711e329b5ad"}
Jul 24 01:37:51.754710 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:51.754526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc6695b48-rqndt" event={"ID":"335890ea-020e-421d-88ff-ba6102a0168f","Type":"ContainerStarted","Data":"738fbbbf09d8bffe616b0dc00e5acfdb83ed67c8fa433517bb32ddca1272f862"}
Jul 24 01:37:51.775456 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:51.775411    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dc6695b48-rqndt" podStartSLOduration=1.77539581 podStartE2EDuration="1.77539581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:37:51.772944401 +0000 UTC m=+484.797342888" watchObservedRunningTime="2026-07-24 01:37:51.77539581 +0000 UTC m=+484.799794287"
Jul 24 01:37:55.726961 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:55.726928    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:37:59.592444 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:59.592410    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:37:59.844627 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:37:59.844551    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:01.033842 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:01.033809    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:38:01.034255 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:01.033889    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:38:01.038606 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:01.038576    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:38:01.805682 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:01.805655    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dc6695b48-rqndt"
Jul 24 01:38:01.852488 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:01.852455    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b9c5dc4c-59d59"]
Jul 24 01:38:01.952571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:01.952543    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:02.054096 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:02.054066    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:02.104885 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:02.104806    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:15.690128 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:15.690093    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:15.790790 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:15.790760    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:15.846154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:15.846121    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:16.082861 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.082774    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:38:16.086402 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.086368    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.088540 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.088518    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 01:38:16.088656 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.088584    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5dwhk\""
Jul 24 01:38:16.096686 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.096663    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:38:16.128244 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.128207    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:38:16.215435 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.215396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410f5229-7d74-4672-a29d-435ade25ab53-config-file\") pod \"limitador-limitador-54d6d988d5-n4rng\" (UID: \"410f5229-7d74-4672-a29d-435ade25ab53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.215609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.215475    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2vcq\" (UniqueName: \"kubernetes.io/projected/410f5229-7d74-4672-a29d-435ade25ab53-kube-api-access-n2vcq\") pod \"limitador-limitador-54d6d988d5-n4rng\" (UID: \"410f5229-7d74-4672-a29d-435ade25ab53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.316931 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.316899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410f5229-7d74-4672-a29d-435ade25ab53-config-file\") pod \"limitador-limitador-54d6d988d5-n4rng\" (UID: \"410f5229-7d74-4672-a29d-435ade25ab53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.317104 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.316959    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2vcq\" (UniqueName: \"kubernetes.io/projected/410f5229-7d74-4672-a29d-435ade25ab53-kube-api-access-n2vcq\") pod \"limitador-limitador-54d6d988d5-n4rng\" (UID: \"410f5229-7d74-4672-a29d-435ade25ab53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.317672 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.317638    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410f5229-7d74-4672-a29d-435ade25ab53-config-file\") pod \"limitador-limitador-54d6d988d5-n4rng\" (UID: \"410f5229-7d74-4672-a29d-435ade25ab53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.324356 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.324335    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2vcq\" (UniqueName: \"kubernetes.io/projected/410f5229-7d74-4672-a29d-435ade25ab53-kube-api-access-n2vcq\") pod \"limitador-limitador-54d6d988d5-n4rng\" (UID: \"410f5229-7d74-4672-a29d-435ade25ab53\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.397698 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.397628    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:16.508341 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.508312    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:16.531071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.531047    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:38:16.533486 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:38:16.533458    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410f5229_7d74_4672_a29d_435ade25ab53.slice/crio-c2edcfeaae73083bfb70505bae7338e98507ff293d8d80a048920ee5d3f20d0e WatchSource:0}: Error finding container c2edcfeaae73083bfb70505bae7338e98507ff293d8d80a048920ee5d3f20d0e: Status 404 returned error can't find the container with id c2edcfeaae73083bfb70505bae7338e98507ff293d8d80a048920ee5d3f20d0e
Jul 24 01:38:16.565258 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.565225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:16.870399 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:16.870368    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng" event={"ID":"410f5229-7d74-4672-a29d-435ade25ab53","Type":"ContainerStarted","Data":"c2edcfeaae73083bfb70505bae7338e98507ff293d8d80a048920ee5d3f20d0e"}
Jul 24 01:38:19.886095 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:19.886058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng" event={"ID":"410f5229-7d74-4672-a29d-435ade25ab53","Type":"ContainerStarted","Data":"b8b6d2e081ebd3b2996293829d989823fff94b05023c00e4efc28072afe5d0cf"}
Jul 24 01:38:19.886616 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:19.886308    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:19.902031 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:19.901946    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng" podStartSLOduration=1.079751348 podStartE2EDuration="3.901931699s" totalImagesPullingTime="2.822180351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:38:19.900810683 +0000 UTC m=+512.925209165" watchObservedRunningTime="2026-07-24 01:38:19.901931699 +0000 UTC m=+512.926330176"
Jul 24 01:38:26.878361 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:26.878319    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57b9c5dc4c-59d59" podUID="6dda124a-76af-43b3-b0e6-64a6f1ab726e" containerName="console" containerID="cri-o://b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0" gracePeriod=15
Jul 24 01:38:27.125022 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.124996    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:38:27.224724 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224685    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-config\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.224916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224743    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgkmz\" (UniqueName: \"kubernetes.io/projected/6dda124a-76af-43b3-b0e6-64a6f1ab726e-kube-api-access-mgkmz\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.224916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224778    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-oauth-serving-cert\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.224916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-oauth-config\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.224916 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224863    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-trusted-ca-bundle\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.225123 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224926    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-service-ca\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.225123 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.224973    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-serving-cert\") pod \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\" (UID: \"6dda124a-76af-43b3-b0e6-64a6f1ab726e\") "
Jul 24 01:38:27.225260 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.225140    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-config" (OuterVolumeSpecName: "console-config") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:38:27.225320 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.225275    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:38:27.225461 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.225433    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-service-ca" (OuterVolumeSpecName: "service-ca") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:38:27.225461 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.225446    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:38:27.225646 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.225449    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.225646 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.225498    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-oauth-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.226941 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.226917    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dda124a-76af-43b3-b0e6-64a6f1ab726e-kube-api-access-mgkmz" (OuterVolumeSpecName: "kube-api-access-mgkmz") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "kube-api-access-mgkmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:38:27.227035 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.227014    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:38:27.227035 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.227028    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6dda124a-76af-43b3-b0e6-64a6f1ab726e" (UID: "6dda124a-76af-43b3-b0e6-64a6f1ab726e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:38:27.326540 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.326506    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.326540 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.326536    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-serving-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.326540 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.326546    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgkmz\" (UniqueName: \"kubernetes.io/projected/6dda124a-76af-43b3-b0e6-64a6f1ab726e-kube-api-access-mgkmz\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.326782 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.326557    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dda124a-76af-43b3-b0e6-64a6f1ab726e-console-oauth-config\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.326782 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.326565    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dda124a-76af-43b3-b0e6-64a6f1ab726e-trusted-ca-bundle\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:38:27.923547 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.923455    2568 generic.go:356] "Generic (PLEG): container finished" podID="6dda124a-76af-43b3-b0e6-64a6f1ab726e" containerID="b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0" exitCode=0
Jul 24 01:38:27.923547 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.923519    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b9c5dc4c-59d59"
Jul 24 01:38:27.924021 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.923543    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b9c5dc4c-59d59" event={"ID":"6dda124a-76af-43b3-b0e6-64a6f1ab726e","Type":"ContainerDied","Data":"b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0"}
Jul 24 01:38:27.924021 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.923595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b9c5dc4c-59d59" event={"ID":"6dda124a-76af-43b3-b0e6-64a6f1ab726e","Type":"ContainerDied","Data":"9d92c70e1b2ce2ea7fa4e8e06901c67f98d0e9c1a5445d198f314030e4067095"}
Jul 24 01:38:27.924021 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.923618    2568 scope.go:117] "RemoveContainer" containerID="b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0"
Jul 24 01:38:27.932073 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.932057    2568 scope.go:117] "RemoveContainer" containerID="b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0"
Jul 24 01:38:27.932327 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:38:27.932304    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0\": container with ID starting with b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0 not found: ID does not exist" containerID="b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0"
Jul 24 01:38:27.932413 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.932334    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0"} err="failed to get container status \"b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0\": rpc error: code = NotFound desc = could not find container \"b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0\": container with ID starting with b8e13d9b256167a52a11d3157e4290e967aa299d618dd3ea3f07210ed78ae9c0 not found: ID does not exist"
Jul 24 01:38:27.938719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.938695    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b9c5dc4c-59d59"]
Jul 24 01:38:27.944774 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:27.944753    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b9c5dc4c-59d59"]
Jul 24 01:38:29.504817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:29.504788    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dda124a-76af-43b3-b0e6-64a6f1ab726e" path="/var/lib/kubelet/pods/6dda124a-76af-43b3-b0e6-64a6f1ab726e/volumes"
Jul 24 01:38:30.891385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:30.891358    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n4rng"
Jul 24 01:38:37.022415 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:37.022380    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:37.119911 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:37.119881    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:37.580193 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:37.580132    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:48.386486 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:48.386456    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:48.437980 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:48.437949    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:49.883229 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:49.883197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:49.996896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:49.996863    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:57.103512 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:57.103475    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:57.200025 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:57.199997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:38:57.254237 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:38:57.254208    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:00.285075 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:00.285045    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:00.383951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:00.383916    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:01.649873 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:01.649838    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:30.424763 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:30.424725    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:30.515539 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:30.515507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:31.031952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:31.031925    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:31.178683 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:31.178655    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:31.598905 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:31.598873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:31.696747 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:31.696710    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:31.790984 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:31.790954    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:39:40.958345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:40.958305    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:41.056278 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:41.056242    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:50.195689 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:50.195658    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:39:50.592095 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:50.592018    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:39:51.368756 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:39:51.368724    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:05.586440 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:05.586403    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:06.575869 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:06.575835    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:40:12.561745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.561659    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"]
Jul 24 01:40:12.562125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.562023    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dda124a-76af-43b3-b0e6-64a6f1ab726e" containerName="console"
Jul 24 01:40:12.562125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.562034    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dda124a-76af-43b3-b0e6-64a6f1ab726e" containerName="console"
Jul 24 01:40:12.562125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.562090    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dda124a-76af-43b3-b0e6-64a6f1ab726e" containerName="console"
Jul 24 01:40:12.565298 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.565274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.567587 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.567560    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 01:40:12.567885 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.567867    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 01:40:12.568657 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.568641    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bqxvq\""
Jul 24 01:40:12.568735 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.568645    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 01:40:12.576209 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.576187    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"]
Jul 24 01:40:12.587839 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.587811    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:12.593217 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.593197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.593313 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.593252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.593313 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.593269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfn7\" (UniqueName: \"kubernetes.io/projected/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-kube-api-access-bsfn7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.593389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.593314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.593389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.593353    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.593389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.593375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.693972 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.693943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.693972 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.693976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfn7\" (UniqueName: \"kubernetes.io/projected/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-kube-api-access-bsfn7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694233 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.693997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694233 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.694021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694233 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.694041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694233 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.694102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694457 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.694435    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694517 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.694479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.694591 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.694549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.696328 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.696301    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.696522 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.696506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.701868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.701849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfn7\" (UniqueName: \"kubernetes.io/projected/04f0042a-48f8-4b23-ab38-d0d6da4a51fb-kube-api-access-bsfn7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kfpcz\" (UID: \"04f0042a-48f8-4b23-ab38-d0d6da4a51fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:12.876435 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:12.876340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:13.007312 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:13.007283    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"]
Jul 24 01:40:13.010599 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:40:13.010567    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f0042a_48f8_4b23_ab38_d0d6da4a51fb.slice/crio-21541df2149b47990295ba62406d7cc544c08941be559b12ac02cb54409b7d9a WatchSource:0}: Error finding container 21541df2149b47990295ba62406d7cc544c08941be559b12ac02cb54409b7d9a: Status 404 returned error can't find the container with id 21541df2149b47990295ba62406d7cc544c08941be559b12ac02cb54409b7d9a
Jul 24 01:40:13.012154 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:13.012139    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 01:40:13.444042 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:13.443950    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz" event={"ID":"04f0042a-48f8-4b23-ab38-d0d6da4a51fb","Type":"ContainerStarted","Data":"21541df2149b47990295ba62406d7cc544c08941be559b12ac02cb54409b7d9a"}
Jul 24 01:40:13.675745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:13.675716    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:40:14.450280 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:14.450249    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz" event={"ID":"04f0042a-48f8-4b23-ab38-d0d6da4a51fb","Type":"ContainerStarted","Data":"7295458ed42953a6ec1ead42af5f1867613cd61c2ec7a65ce7746aed3460d7cf"}
Jul 24 01:40:14.467439 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:14.467383    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz" podStartSLOduration=1.438658348 podStartE2EDuration="2.467362882s" totalImagesPullingTime="1.028704534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:40:14.466408609 +0000 UTC m=+627.490807085" watchObservedRunningTime="2026-07-24 01:40:14.467362882 +0000 UTC m=+627.491761362"
Jul 24 01:40:19.899897 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:19.899864    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:21.387622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:21.387585    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:40:22.876840 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:22.876804    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:22.877266 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:22.876861    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:22.889252 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:22.889213    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:23.506006 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:23.505976    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kfpcz"
Jul 24 01:40:32.104125 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:32.104092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:33.989910 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:33.989879    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:40:35.807794 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:35.807766    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:44.982638 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:44.982591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:40:59.418965 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:59.418924    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:40:59.468674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:40:59.468636    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:41:40.178079 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:41:40.177995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:41:43.304092 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:41:43.304049    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:41:43.397578 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:41:43.397538    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:41:44.561397 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:41:44.561351    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:41:44.660993 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:41:44.660956    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:41:59.248847 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:41:59.248799    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:42:16.290744 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:42:16.290706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:42:25.281479 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:42:25.281436    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:42:36.582972 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:42:36.582937    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:42:39.014409 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:42:39.014373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:42:39.061533 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:42:39.061502    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:43:51.870436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:43:51.870400    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:43:53.430940 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:43:53.430910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:16.036924 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:16.036886    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:16.137126 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:16.137092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:18.087486 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:18.087453    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:44:30.184342 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:30.184303    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:44:35.168259 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:35.168223    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:35.267708 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:35.267672    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:35.409647 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:35.409607    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:40.973470 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:40.973379    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:41.074025 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:41.073990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:41.173514 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:41.173474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:41.330100 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:41.330013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:47.035000 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:47.034968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:44:47.136709 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:44:47.136676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:45:05.185444 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:05.185410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:45:14.375867 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:14.375831    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:45:22.990795 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:22.990759    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:45:32.486206 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:32.486155    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:45:41.979318 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:41.979282    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:45:42.147454 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:42.147420    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:45:53.477138 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:45:53.477102    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:46:04.086169 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:46:04.086134    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:46:13.280792 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:46:13.280706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:46:34.988431 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:46:34.988396    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:46:45.181667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:46:45.181634    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:47:08.289843 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:47:08.289799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:47:18.681751 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:47:18.681716    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:47:34.689270 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:47:34.689231    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:47:44.379328 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:47:44.379244    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:47:53.788271 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:47:53.788234    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:48:05.588155 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:05.588116    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:48:15.084567 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:15.084530    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:48:27.027911 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:27.027866    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:48:39.784256 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:39.784224    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"]
Jul 24 01:48:39.784735 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:39.784410    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b" podUID="28472e74-edc0-4627-a41d-dcba738701da" containerName="manager" containerID="cri-o://10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c" gracePeriod=10
Jul 24 01:48:41.743371 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.743344    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:48:41.872955 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.872864    2568 generic.go:356] "Generic (PLEG): container finished" podID="28472e74-edc0-4627-a41d-dcba738701da" containerID="10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c" exitCode=0
Jul 24 01:48:41.872955 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.872904    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"
Jul 24 01:48:41.872955 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.872941    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b" event={"ID":"28472e74-edc0-4627-a41d-dcba738701da","Type":"ContainerDied","Data":"10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c"}
Jul 24 01:48:41.873200 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.872990    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b" event={"ID":"28472e74-edc0-4627-a41d-dcba738701da","Type":"ContainerDied","Data":"bdf69945cc06c01629e83d215e661ea3e8b419f7e4ee4669da46018c0920cfac"}
Jul 24 01:48:41.873200 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.873012    2568 scope.go:117] "RemoveContainer" containerID="10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c"
Jul 24 01:48:41.882378 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.882361    2568 scope.go:117] "RemoveContainer" containerID="10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c"
Jul 24 01:48:41.882641 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:48:41.882623    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c\": container with ID starting with 10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c not found: ID does not exist" containerID="10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c"
Jul 24 01:48:41.882695 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.882656    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c"} err="failed to get container status \"10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c\": rpc error: code = NotFound desc = could not find container \"10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c\": container with ID starting with 10d0ff0b790309e762a2baac1705c18e90a23641c42a639c3c308bfff6ca442c not found: ID does not exist"
Jul 24 01:48:41.899976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.899953    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28472e74-edc0-4627-a41d-dcba738701da-extensions-socket-volume\") pod \"28472e74-edc0-4627-a41d-dcba738701da\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") "
Jul 24 01:48:41.900070 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.900044    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n7ml\" (UniqueName: \"kubernetes.io/projected/28472e74-edc0-4627-a41d-dcba738701da-kube-api-access-4n7ml\") pod \"28472e74-edc0-4627-a41d-dcba738701da\" (UID: \"28472e74-edc0-4627-a41d-dcba738701da\") "
Jul 24 01:48:41.900350 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.900328    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28472e74-edc0-4627-a41d-dcba738701da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "28472e74-edc0-4627-a41d-dcba738701da" (UID: "28472e74-edc0-4627-a41d-dcba738701da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:48:41.901943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:41.901923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28472e74-edc0-4627-a41d-dcba738701da-kube-api-access-4n7ml" (OuterVolumeSpecName: "kube-api-access-4n7ml") pod "28472e74-edc0-4627-a41d-dcba738701da" (UID: "28472e74-edc0-4627-a41d-dcba738701da"). InnerVolumeSpecName "kube-api-access-4n7ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:48:42.000891 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:42.000851    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n7ml\" (UniqueName: \"kubernetes.io/projected/28472e74-edc0-4627-a41d-dcba738701da-kube-api-access-4n7ml\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:48:42.000891 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:42.000883    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28472e74-edc0-4627-a41d-dcba738701da-extensions-socket-volume\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:48:42.196835 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:42.196805    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"]
Jul 24 01:48:42.202371 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:42.202344    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zbx7b"]
Jul 24 01:48:43.505514 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:43.505481    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28472e74-edc0-4627-a41d-dcba738701da" path="/var/lib/kubelet/pods/28472e74-edc0-4627-a41d-dcba738701da/volumes"
Jul 24 01:48:43.548998 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:43.548942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:48:43.600975 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:48:43.600947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:49:40.996622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:40.996584    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"]
Jul 24 01:49:40.997046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:40.996948    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28472e74-edc0-4627-a41d-dcba738701da" containerName="manager"
Jul 24 01:49:40.997046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:40.996958    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="28472e74-edc0-4627-a41d-dcba738701da" containerName="manager"
Jul 24 01:49:40.997046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:40.997027    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="28472e74-edc0-4627-a41d-dcba738701da" containerName="manager"
Jul 24 01:49:41.000140 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.000123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.003501 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.003483    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zkr7f\""
Jul 24 01:49:41.011366 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.011343    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"]
Jul 24 01:49:41.034804 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.034780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8zv\" (UniqueName: \"kubernetes.io/projected/cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0-kube-api-access-5g8zv\") pod \"kuadrant-operator-controller-manager-86878c769f-95j5r\" (UID: \"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.034905 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.034816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-95j5r\" (UID: \"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.135473 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.135442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8zv\" (UniqueName: \"kubernetes.io/projected/cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0-kube-api-access-5g8zv\") pod \"kuadrant-operator-controller-manager-86878c769f-95j5r\" (UID: \"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.135473 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.135477    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-95j5r\" (UID: \"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.135845 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.135827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-95j5r\" (UID: \"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.143073 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.143049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8zv\" (UniqueName: \"kubernetes.io/projected/cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0-kube-api-access-5g8zv\") pod \"kuadrant-operator-controller-manager-86878c769f-95j5r\" (UID: \"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.309989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.309897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:41.446923 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:41.446897    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"]
Jul 24 01:49:41.449613 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:49:41.449570    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee2bc06_83f6_41f6_a6dc_ca9d8dacc2c0.slice/crio-2b72aa9b4fca319c98790c63f17334156d322b537a0e583f8190878c759625fa WatchSource:0}: Error finding container 2b72aa9b4fca319c98790c63f17334156d322b537a0e583f8190878c759625fa: Status 404 returned error can't find the container with id 2b72aa9b4fca319c98790c63f17334156d322b537a0e583f8190878c759625fa
Jul 24 01:49:42.151658 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:42.151626    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r" event={"ID":"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0","Type":"ContainerStarted","Data":"e1cd989aabd8959238119f2383e0cbf541604991423a06446d0d8cc0afdd8777"}
Jul 24 01:49:42.152046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:42.151678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r" event={"ID":"cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0","Type":"ContainerStarted","Data":"2b72aa9b4fca319c98790c63f17334156d322b537a0e583f8190878c759625fa"}
Jul 24 01:49:42.152046 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:42.151700    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:49:42.175153 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:42.175102    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r" podStartSLOduration=2.17508821 podStartE2EDuration="2.17508821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:49:42.172678173 +0000 UTC m=+1195.197076662" watchObservedRunningTime="2026-07-24 01:49:42.17508821 +0000 UTC m=+1195.199486686"
Jul 24 01:49:45.134527 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:45.134479    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:49:53.159481 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:49:53.159450    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95j5r"
Jul 24 01:50:02.988871 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:02.988835    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:50:11.589990 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:11.589956    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:50:24.382089 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:24.382052    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:50:37.593483 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:37.593452    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:50:43.174344 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:43.174306    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:50:46.882723 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:46.882683    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:50:58.380758 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:50:58.380722    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:51:06.383589 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:51:06.383554    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:51:16.884276 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:51:16.884239    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:51:28.180835 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:51:28.180795    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:51:38.183190 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:51:38.182856    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:51:48.677018 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:51:48.676981    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:52:10.585304 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:10.585225    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:52:20.184976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:20.184938    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:52:24.578344 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.578307    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"]
Jul 24 01:52:24.581935 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.581919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.584084 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.584063    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c7a94cee-kserve-self-signed-certs\""
Jul 24 01:52:24.596950 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.596917    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"]
Jul 24 01:52:24.634463 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.634425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw2m4\" (UniqueName: \"kubernetes.io/projected/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-kube-api-access-tw2m4\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.634648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.634481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-dshm\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.634648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.634596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-home\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.634648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.634639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tmp-dir\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.634814 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.634682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tls-certs\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.634814 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.634730    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-model-cache\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.696803 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.696769    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:52:24.735894 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.735862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw2m4\" (UniqueName: \"kubernetes.io/projected/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-kube-api-access-tw2m4\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736060 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.735900    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-dshm\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736060 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.735941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-home\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736060 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.735961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tmp-dir\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736060 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.735983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tls-certs\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736060 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.736014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-model-cache\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736446 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.736425    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-home\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736507 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.736449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tmp-dir\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.736562 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.736513    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-model-cache\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.738295 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.738275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-dshm\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.738557 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.738536    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tls-certs\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.743633 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.743608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw2m4\" (UniqueName: \"kubernetes.io/projected/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-kube-api-access-tw2m4\") pod \"e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") " pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:24.905305 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:24.905217    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:25.037623 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:25.037598    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"]
Jul 24 01:52:25.040019 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:52:25.039984    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8821b6c4_3f0c_4139_9e36_66cb1d4b4794.slice/crio-446b1d8f74a0bfe6ec2df6cfeedb71ce4889bc409df36faffbad66ae2ddc0106 WatchSource:0}: Error finding container 446b1d8f74a0bfe6ec2df6cfeedb71ce4889bc409df36faffbad66ae2ddc0106: Status 404 returned error can't find the container with id 446b1d8f74a0bfe6ec2df6cfeedb71ce4889bc409df36faffbad66ae2ddc0106
Jul 24 01:52:25.918564 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:25.918529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7" event={"ID":"8821b6c4-3f0c-4139-9e36-66cb1d4b4794","Type":"ContainerStarted","Data":"eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a"}
Jul 24 01:52:25.918564 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:25.918568    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7" event={"ID":"8821b6c4-3f0c-4139-9e36-66cb1d4b4794","Type":"ContainerStarted","Data":"446b1d8f74a0bfe6ec2df6cfeedb71ce4889bc409df36faffbad66ae2ddc0106"}
Jul 24 01:52:25.935010 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:25.934965    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7" podStartSLOduration=1.934951067 podStartE2EDuration="1.934951067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:52:25.933500548 +0000 UTC m=+1358.957899025" watchObservedRunningTime="2026-07-24 01:52:25.934951067 +0000 UTC m=+1358.959349573"
Jul 24 01:52:28.063511 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.063470    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"]
Jul 24 01:52:28.066766 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.066747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.069352 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.069333    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c7a94cee-kserve-self-signed-certs\""
Jul 24 01:52:28.075225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.075203    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"]
Jul 24 01:52:28.089298 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.089275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:52:28.169430 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.169403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tmp-dir\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.169603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.169440    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-dshm\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.169603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.169463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-model-cache\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.169603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.169524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-home\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.169603 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.169567    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fr5d\" (UniqueName: \"kubernetes.io/projected/e9a20d32-d0b8-4adb-a90a-b58c06df867d-kube-api-access-9fr5d\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.169791 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.169615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tls-certs\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270504 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tmp-dir\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-dshm\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-model-cache\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270580    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-home\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fr5d\" (UniqueName: \"kubernetes.io/projected/e9a20d32-d0b8-4adb-a90a-b58c06df867d-kube-api-access-9fr5d\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270706 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tls-certs\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.270988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tmp-dir\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.271047 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.270989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-model-cache\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.271047 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.271003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-home\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.272769 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.272748    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-dshm\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.273029 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.273013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tls-certs\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.280674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.280651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fr5d\" (UniqueName: \"kubernetes.io/projected/e9a20d32-d0b8-4adb-a90a-b58c06df867d-kube-api-access-9fr5d\") pod \"e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") " pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.377105 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.377020    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:28.523139 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.523112    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"]
Jul 24 01:52:28.524986 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:52:28.524961    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9a20d32_d0b8_4adb_a90a_b58c06df867d.slice/crio-c8663de6af28f2a16a1c6e738e309ee378b92e90ab4fd54d01f3da2d90e4f9f7 WatchSource:0}: Error finding container c8663de6af28f2a16a1c6e738e309ee378b92e90ab4fd54d01f3da2d90e4f9f7: Status 404 returned error can't find the container with id c8663de6af28f2a16a1c6e738e309ee378b92e90ab4fd54d01f3da2d90e4f9f7
Jul 24 01:52:28.935289 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.935250    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl" event={"ID":"e9a20d32-d0b8-4adb-a90a-b58c06df867d","Type":"ContainerStarted","Data":"b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc"}
Jul 24 01:52:28.935473 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.935301    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl" event={"ID":"e9a20d32-d0b8-4adb-a90a-b58c06df867d","Type":"ContainerStarted","Data":"c8663de6af28f2a16a1c6e738e309ee378b92e90ab4fd54d01f3da2d90e4f9f7"}
Jul 24 01:52:28.953196 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:28.953131    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl" podStartSLOduration=0.953114828 podStartE2EDuration="953.114828ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:52:28.950643812 +0000 UTC m=+1361.975042288" watchObservedRunningTime="2026-07-24 01:52:28.953114828 +0000 UTC m=+1361.977513304"
Jul 24 01:52:34.906077 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:34.905982    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:34.906489 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:34.906233    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:34.918490 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:34.918472    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:34.974827 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:34.974797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:52:36.884931 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:36.884896    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:52:38.377562 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:38.377530    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:38.377562 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:38.377570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:38.390219 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:38.390195    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:52:38.993443 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:52:38.993416    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:53:08.095438 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:08.095400    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"]
Jul 24 01:53:08.108377 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:08.108347    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:53:09.582421 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:09.582389    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"]
Jul 24 01:53:09.602385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:09.602358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:53:11.979710 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:11.979677    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:53:23.114800 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.114736    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7" podUID="8821b6c4-3f0c-4139-9e36-66cb1d4b4794" containerName="main" containerID="cri-o://eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a" gracePeriod=45
Jul 24 01:53:23.370926 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.370864    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:53:23.483542 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483509    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw2m4\" (UniqueName: \"kubernetes.io/projected/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-kube-api-access-tw2m4\") pod \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") "
Jul 24 01:53:23.483713 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483608    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tmp-dir\") pod \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") "
Jul 24 01:53:23.483713 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483658    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-home\") pod \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") "
Jul 24 01:53:23.483786 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483730    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tls-certs\") pod \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") "
Jul 24 01:53:23.483786 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483761    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-dshm\") pod \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") "
Jul 24 01:53:23.483876 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483789    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-model-cache\") pod \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\" (UID: \"8821b6c4-3f0c-4139-9e36-66cb1d4b4794\") "
Jul 24 01:53:23.483931 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483861    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8821b6c4-3f0c-4139-9e36-66cb1d4b4794" (UID: "8821b6c4-3f0c-4139-9e36-66cb1d4b4794"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:23.483988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.483940    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-home" (OuterVolumeSpecName: "home") pod "8821b6c4-3f0c-4139-9e36-66cb1d4b4794" (UID: "8821b6c4-3f0c-4139-9e36-66cb1d4b4794"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:23.484097 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.484079    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:23.484097 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.484095    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:23.484249 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.484103    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-model-cache" (OuterVolumeSpecName: "model-cache") pod "8821b6c4-3f0c-4139-9e36-66cb1d4b4794" (UID: "8821b6c4-3f0c-4139-9e36-66cb1d4b4794"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:23.485821 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.485794    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-dshm" (OuterVolumeSpecName: "dshm") pod "8821b6c4-3f0c-4139-9e36-66cb1d4b4794" (UID: "8821b6c4-3f0c-4139-9e36-66cb1d4b4794"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:23.485925 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.485858    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8821b6c4-3f0c-4139-9e36-66cb1d4b4794" (UID: "8821b6c4-3f0c-4139-9e36-66cb1d4b4794"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:53:23.485925 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.485908    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-kube-api-access-tw2m4" (OuterVolumeSpecName: "kube-api-access-tw2m4") pod "8821b6c4-3f0c-4139-9e36-66cb1d4b4794" (UID: "8821b6c4-3f0c-4139-9e36-66cb1d4b4794"). InnerVolumeSpecName "kube-api-access-tw2m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:53:23.585244 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.585211    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:23.585244 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.585236    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:23.585244 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.585245    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:23.585462 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:23.585253    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw2m4\" (UniqueName: \"kubernetes.io/projected/8821b6c4-3f0c-4139-9e36-66cb1d4b4794-kube-api-access-tw2m4\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:24.196560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.196528    2568 generic.go:356] "Generic (PLEG): container finished" podID="8821b6c4-3f0c-4139-9e36-66cb1d4b4794" containerID="eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a" exitCode=0
Jul 24 01:53:24.196980 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.196570    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"
Jul 24 01:53:24.196980 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.196608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7" event={"ID":"8821b6c4-3f0c-4139-9e36-66cb1d4b4794","Type":"ContainerDied","Data":"eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a"}
Jul 24 01:53:24.196980 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.196650    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7" event={"ID":"8821b6c4-3f0c-4139-9e36-66cb1d4b4794","Type":"ContainerDied","Data":"446b1d8f74a0bfe6ec2df6cfeedb71ce4889bc409df36faffbad66ae2ddc0106"}
Jul 24 01:53:24.196980 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.196666    2568 scope.go:117] "RemoveContainer" containerID="eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a"
Jul 24 01:53:24.205202 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.205168    2568 scope.go:117] "RemoveContainer" containerID="eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a"
Jul 24 01:53:24.205439 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:53:24.205423    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a\": container with ID starting with eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a not found: ID does not exist" containerID="eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a"
Jul 24 01:53:24.205496 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.205454    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a"} err="failed to get container status \"eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a\": rpc error: code = NotFound desc = could not find container \"eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a\": container with ID starting with eeee4797c2f10c75d0402786c3d382649c0af04287381944bc5436fe3c519d4a not found: ID does not exist"
Jul 24 01:53:24.211922 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.211900    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"]
Jul 24 01:53:24.215752 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.215731    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c7a94cee-kserve-679b74fbff-kcxq7"]
Jul 24 01:53:24.280714 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.280683    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:53:24.601807 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.601722    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl" podUID="e9a20d32-d0b8-4adb-a90a-b58c06df867d" containerName="main" containerID="cri-o://b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc" gracePeriod=45
Jul 24 01:53:24.864432 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.864380    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:53:24.998784 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.998751    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-dshm\") pod \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") "
Jul 24 01:53:24.998784 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.998787    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tmp-dir\") pod \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") "
Jul 24 01:53:24.998989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.998860    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-home\") pod \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") "
Jul 24 01:53:24.998989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.998921    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tls-certs\") pod \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") "
Jul 24 01:53:24.998989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.998981    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fr5d\" (UniqueName: \"kubernetes.io/projected/e9a20d32-d0b8-4adb-a90a-b58c06df867d-kube-api-access-9fr5d\") pod \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") "
Jul 24 01:53:24.999130 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.999023    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-model-cache\") pod \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\" (UID: \"e9a20d32-d0b8-4adb-a90a-b58c06df867d\") "
Jul 24 01:53:24.999217 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.999159    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-home" (OuterVolumeSpecName: "home") pod "e9a20d32-d0b8-4adb-a90a-b58c06df867d" (UID: "e9a20d32-d0b8-4adb-a90a-b58c06df867d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:24.999217 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.999157    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9a20d32-d0b8-4adb-a90a-b58c06df867d" (UID: "e9a20d32-d0b8-4adb-a90a-b58c06df867d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:24.999389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.999362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9a20d32-d0b8-4adb-a90a-b58c06df867d" (UID: "e9a20d32-d0b8-4adb-a90a-b58c06df867d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:24.999389 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.999385    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:24.999492 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:24.999403    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:25.000967 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.000947    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-dshm" (OuterVolumeSpecName: "dshm") pod "e9a20d32-d0b8-4adb-a90a-b58c06df867d" (UID: "e9a20d32-d0b8-4adb-a90a-b58c06df867d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:53:25.000967 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.000956    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9a20d32-d0b8-4adb-a90a-b58c06df867d" (UID: "e9a20d32-d0b8-4adb-a90a-b58c06df867d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 01:53:25.001103 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.001000    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a20d32-d0b8-4adb-a90a-b58c06df867d-kube-api-access-9fr5d" (OuterVolumeSpecName: "kube-api-access-9fr5d") pod "e9a20d32-d0b8-4adb-a90a-b58c06df867d" (UID: "e9a20d32-d0b8-4adb-a90a-b58c06df867d"). InnerVolumeSpecName "kube-api-access-9fr5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:53:25.100368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.100331    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a20d32-d0b8-4adb-a90a-b58c06df867d-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:25.100368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.100361    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fr5d\" (UniqueName: \"kubernetes.io/projected/e9a20d32-d0b8-4adb-a90a-b58c06df867d-kube-api-access-9fr5d\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:25.100368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.100370    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:25.100368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.100378    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a20d32-d0b8-4adb-a90a-b58c06df867d-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:53:25.203622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.203586    2568 generic.go:356] "Generic (PLEG): container finished" podID="e9a20d32-d0b8-4adb-a90a-b58c06df867d" containerID="b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc" exitCode=0
Jul 24 01:53:25.204071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.203634    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"
Jul 24 01:53:25.204071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.203671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl" event={"ID":"e9a20d32-d0b8-4adb-a90a-b58c06df867d","Type":"ContainerDied","Data":"b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc"}
Jul 24 01:53:25.204071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.203722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl" event={"ID":"e9a20d32-d0b8-4adb-a90a-b58c06df867d","Type":"ContainerDied","Data":"c8663de6af28f2a16a1c6e738e309ee378b92e90ab4fd54d01f3da2d90e4f9f7"}
Jul 24 01:53:25.204071 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.203739    2568 scope.go:117] "RemoveContainer" containerID="b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc"
Jul 24 01:53:25.212588 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.212566    2568 scope.go:117] "RemoveContainer" containerID="b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc"
Jul 24 01:53:25.212834 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:53:25.212816    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc\": container with ID starting with b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc not found: ID does not exist" containerID="b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc"
Jul 24 01:53:25.212883 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.212843    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc"} err="failed to get container status \"b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc\": rpc error: code = NotFound desc = could not find container \"b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc\": container with ID starting with b0f96440c16c521e195dc9d8499b6d5b2ec760413339a6f1bd02c2c87ecad9fc not found: ID does not exist"
Jul 24 01:53:25.224516 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.224497    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"]
Jul 24 01:53:25.229166 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.229144    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c7a94cee-kserve-8459679b5f-jfgfl"]
Jul 24 01:53:25.505244 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.505153    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8821b6c4-3f0c-4139-9e36-66cb1d4b4794" path="/var/lib/kubelet/pods/8821b6c4-3f0c-4139-9e36-66cb1d4b4794/volumes"
Jul 24 01:53:25.505635 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:25.505613    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a20d32-d0b8-4adb-a90a-b58c06df867d" path="/var/lib/kubelet/pods/e9a20d32-d0b8-4adb-a90a-b58c06df867d/volumes"
Jul 24 01:53:31.089045 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:31.089011    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:53:40.683655 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:40.683566    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:53:48.583990 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:48.583953    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:53:58.580932 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:53:58.580896    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:54:07.784145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:07.784109    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:54:17.987260 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:17.987199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:54:27.184929 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:27.184874    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:54:27.973952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:27.973914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:54:36.683713 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:36.683678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:54:48.780900 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:48.780868    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:54:58.786171 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:54:58.786139    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:55:08.389107 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:55:08.389064    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:55:20.677143 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:55:20.677106    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:55:32.881957 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:55:32.881921    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:55:41.785438 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:55:41.785406    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:55:53.682834 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:55:53.682799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:56:05.484906 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:05.484864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:56:15.978229 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:15.978189    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:56:18.388954 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:18.388921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:28.882448 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:28.882410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:56:38.679384 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:38.679351    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:56:39.359392 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:39.359315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:42.643869 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:42.643826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:42.789872 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:42.789838    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:43.138869 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:43.138834    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:48.382424 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:48.382392    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:56:48.964675 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:48.964629    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:49.019365 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.019332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:49.199899 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.199864    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:49.579622 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.579592    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"]
Jul 24 01:56:49.579989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.579969    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a20d32-d0b8-4adb-a90a-b58c06df867d" containerName="main"
Jul 24 01:56:49.579989 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.579980    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a20d32-d0b8-4adb-a90a-b58c06df867d" containerName="main"
Jul 24 01:56:49.580061 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.579993    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8821b6c4-3f0c-4139-9e36-66cb1d4b4794" containerName="main"
Jul 24 01:56:49.580061 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.579999    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8821b6c4-3f0c-4139-9e36-66cb1d4b4794" containerName="main"
Jul 24 01:56:49.580134 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.580065    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8821b6c4-3f0c-4139-9e36-66cb1d4b4794" containerName="main"
Jul 24 01:56:49.580134 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.580074    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a20d32-d0b8-4adb-a90a-b58c06df867d" containerName="main"
Jul 24 01:56:49.583275 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.583254    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.585753 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.585736    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-44fb0de5-openshift-default-dockercfg-dnd9b\""
Jul 24 01:56:49.606059 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.606037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"]
Jul 24 01:56:49.608052 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.608027    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:49.700633 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700603    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-data\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700633 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-socket\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-certs\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xglmq\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-kube-api-access-xglmq\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700754    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-credential-socket\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-podinfo\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df09ee3-1c77-47d8-bca8-56325ddb345c-istiod-ca-cert\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-envoy\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.700903 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.700897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-token\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.710056 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.710026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:49.801771 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.801735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-data\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.801771 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.801778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-socket\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.801988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.801808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-certs\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.801988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.801836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xglmq\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-kube-api-access-xglmq\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.801988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.801874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-credential-socket\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.801988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.801905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-podinfo\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802215 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df09ee3-1c77-47d8-bca8-56325ddb345c-istiod-ca-cert\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802215 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-envoy\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802215 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-token\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802215 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-data\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802431 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802294    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-certs\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802431 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802420    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-credential-socket\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802549 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802448    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-socket\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.802745 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.802722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df09ee3-1c77-47d8-bca8-56325ddb345c-istiod-ca-cert\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.804352 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.804333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-envoy\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.804493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.804475    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-podinfo\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.811317 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.811293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xglmq\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-kube-api-access-xglmq\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.811434 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.811330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-token\") pod \"e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") " pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:49.893469 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:49.893388    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:50.027343 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.027285    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"]
Jul 24 01:56:50.029816 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:56:50.029783    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df09ee3_1c77_47d8_bca8_56325ddb345c.slice/crio-e1158cd348482b08321a0d1eff0ff8ef1d85cca3ad5c6574a182e5729417287a WatchSource:0}: Error finding container e1158cd348482b08321a0d1eff0ff8ef1d85cca3ad5c6574a182e5729417287a: Status 404 returned error can't find the container with id e1158cd348482b08321a0d1eff0ff8ef1d85cca3ad5c6574a182e5729417287a
Jul 24 01:56:50.032466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.032426    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:56:50.032608 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.032509    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:56:50.032608 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.032539    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:56:50.178799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.178701    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" event={"ID":"5df09ee3-1c77-47d8-bca8-56325ddb345c","Type":"ContainerStarted","Data":"cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"}
Jul 24 01:56:50.178799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.178770    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" event={"ID":"5df09ee3-1c77-47d8-bca8-56325ddb345c","Type":"ContainerStarted","Data":"e1158cd348482b08321a0d1eff0ff8ef1d85cca3ad5c6574a182e5729417287a"}
Jul 24 01:56:50.198351 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.198295    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" podStartSLOduration=1.198274716 podStartE2EDuration="1.198274716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:56:50.197053907 +0000 UTC m=+1623.221452395" watchObservedRunningTime="2026-07-24 01:56:50.198274716 +0000 UTC m=+1623.222673197"
Jul 24 01:56:50.893740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:50.893707    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:51.533829 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:51.533800    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:51.628703 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:51.628665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:51.690791 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:51.690760    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:51.817677 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:51.817592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:51.898527 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:51.898501    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:52.188089 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:52.188061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:52.189064 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:52.189044    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:56:52.315535 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:52.315504    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:56:52.414155 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:56:52.414128    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:02.484561 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:02.484524    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:57:03.241376 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:03.241344    2568 generic.go:356] "Generic (PLEG): container finished" podID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerID="cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5" exitCode=0
Jul 24 01:57:03.241556 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:03.241417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" event={"ID":"5df09ee3-1c77-47d8-bca8-56325ddb345c","Type":"ContainerDied","Data":"cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"}
Jul 24 01:57:03.241856 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:03.241843    2568 scope.go:117] "RemoveContainer" containerID="cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"
Jul 24 01:57:03.242875 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:03.242844    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:03.242946 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:03.242912    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:03.243003 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:03.242950    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:04.251731 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:04.251686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" event={"ID":"5df09ee3-1c77-47d8-bca8-56325ddb345c","Type":"ContainerStarted","Data":"dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4"}
Jul 24 01:57:04.894149 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:04.894113    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:57:04.895036 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:04.895008    2568 patch_prober.go:28] interesting pod/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 01:57:04.895151 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:04.895061    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 01:57:05.893880 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:05.893845    2568 patch_prober.go:28] interesting pod/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 01:57:05.894344 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:05.893902    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 01:57:06.894676 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:06.894640    2568 patch_prober.go:28] interesting pod/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 01:57:06.895062 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:06.894710    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 01:57:07.188943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:07.188908    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:57:07.894339 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:07.894305    2568 patch_prober.go:28] interesting pod/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 01:57:07.894523 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:07.894355    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 01:57:08.898097 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:08.898065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:57:08.899216 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:08.899197    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:57:19.374155 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:19.374121    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:19.429160 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:19.429101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:27.631022 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:27.630978    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:29.051371 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:29.051328    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:30.993153 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:30.993119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:57:32.243958 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:32.243917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:32.386726 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:32.386699    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"]
Jul 24 01:57:32.386936 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:32.386909    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy" containerID="cri-o://dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4" gracePeriod=30
Jul 24 01:57:32.408879 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:32.408850    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:32.657987 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:32.657900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:32.964885 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:32.964854    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:33.054048 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.054019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:33.164466 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.164435    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:33.486829 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.486797    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"]
Jul 24 01:57:33.490645 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.490622    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.492945 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.492922    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3d183c95-gw-openshift-default-dockercfg-xjb24\""
Jul 24 01:57:33.506661 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.506635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"]
Jul 24 01:57:33.516161 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.516137    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:33.616297 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616266    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-token\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616485 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616303    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95af8f6e-22cb-4d64-bcdf-291c5634a609-istiod-ca-cert\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616485 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616330    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99xt6\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-kube-api-access-99xt6\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616485 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-credential-socket\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616485 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-data\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-podinfo\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616523    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-certs\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616546    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-envoy\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.616667 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.616565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-socket\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.710474 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.710435    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:33.717643 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-data\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717643 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-podinfo\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717761 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-certs\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717761 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717757    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-envoy\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717832 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-socket\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717867 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-token\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717905 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95af8f6e-22cb-4d64-bcdf-291c5634a609-istiod-ca-cert\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.717905 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99xt6\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-kube-api-access-99xt6\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.718063 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.717918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-credential-socket\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.718063 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.718044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-data\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.718225 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.718061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-certs\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.718314 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.718283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-socket\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.718385 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.718342    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-credential-socket\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.718673 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.718651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95af8f6e-22cb-4d64-bcdf-291c5634a609-istiod-ca-cert\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.720134 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.720112    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-envoy\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.720354 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.720337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-podinfo\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.725552 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.725528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99xt6\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-kube-api-access-99xt6\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.725648 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.725551    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-token\") pod \"e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") " pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.801976 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.801892    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:33.939743 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.939681    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"]
Jul 24 01:57:33.942391 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:57:33.942359    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95af8f6e_22cb_4d64_bcdf_291c5634a609.slice/crio-230888a0b049dc7659a5400dcdff56fd0d4c00c21b428c700f32acac41478e2f WatchSource:0}: Error finding container 230888a0b049dc7659a5400dcdff56fd0d4c00c21b428c700f32acac41478e2f: Status 404 returned error can't find the container with id 230888a0b049dc7659a5400dcdff56fd0d4c00c21b428c700f32acac41478e2f
Jul 24 01:57:33.944996 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.944967    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:33.945076 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.945026    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:33.945076 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:33.945057    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:34.407396 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:34.407360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" event={"ID":"95af8f6e-22cb-4d64-bcdf-291c5634a609","Type":"ContainerStarted","Data":"f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"}
Jul 24 01:57:34.407600 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:34.407433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" event={"ID":"95af8f6e-22cb-4d64-bcdf-291c5634a609","Type":"ContainerStarted","Data":"230888a0b049dc7659a5400dcdff56fd0d4c00c21b428c700f32acac41478e2f"}
Jul 24 01:57:34.428368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:34.428318    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podStartSLOduration=1.428305151 podStartE2EDuration="1.428305151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:57:34.426338657 +0000 UTC m=+1667.450737134" watchObservedRunningTime="2026-07-24 01:57:34.428305151 +0000 UTC m=+1667.452703628"
Jul 24 01:57:34.802287 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:34.802242    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:35.807263 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:35.807237    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:35.891199 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:35.891153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:36.112097 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:36.112022    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:36.365756 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:36.365675    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:36.417328 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:36.417301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:36.418240 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:36.418218    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:36.571798 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:36.571772    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:36.666403 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:36.666318    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:57:37.643933 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.643909    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:57:37.757877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757846    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xglmq\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-kube-api-access-xglmq\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757888    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-podinfo\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757906    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-envoy\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757924    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-token\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df09ee3-1c77-47d8-bca8-56325ddb345c-istiod-ca-cert\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757962    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-certs\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.757986    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-socket\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-credential-socket\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758083 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758039    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-data\") pod \"5df09ee3-1c77-47d8-bca8-56325ddb345c\" (UID: \"5df09ee3-1c77-47d8-bca8-56325ddb345c\") "
Jul 24 01:57:37.758558 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758299    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:57:37.758558 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:57:37.758558 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758398    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df09ee3-1c77-47d8-bca8-56325ddb345c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:57:37.758750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758554    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:57:37.758750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758649    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5df09ee3-1c77-47d8-bca8-56325ddb345c-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.758750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758668    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.758750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758681    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.758750 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.758693    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.759172 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.759147    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-data" (OuterVolumeSpecName: "istio-data") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:57:37.760330 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.760307    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:57:37.760436 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.760325    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 01:57:37.760493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.760447    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-kube-api-access-xglmq" (OuterVolumeSpecName: "kube-api-access-xglmq") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "kube-api-access-xglmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:57:37.760493 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.760464    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-token" (OuterVolumeSpecName: "istio-token") pod "5df09ee3-1c77-47d8-bca8-56325ddb345c" (UID: "5df09ee3-1c77-47d8-bca8-56325ddb345c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:57:37.859705 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.859676    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.859705 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.859699    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xglmq\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-kube-api-access-xglmq\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.859705 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.859708    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.859705 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.859717    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:37.859969 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:37.859724    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5df09ee3-1c77-47d8-bca8-56325ddb345c-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:57:38.429029 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.428985    2568 generic.go:356] "Generic (PLEG): container finished" podID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerID="dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4" exitCode=0
Jul 24 01:57:38.429267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.429041    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"
Jul 24 01:57:38.429267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.429070    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" event={"ID":"5df09ee3-1c77-47d8-bca8-56325ddb345c","Type":"ContainerDied","Data":"dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4"}
Jul 24 01:57:38.429267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.429126    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6" event={"ID":"5df09ee3-1c77-47d8-bca8-56325ddb345c","Type":"ContainerDied","Data":"e1158cd348482b08321a0d1eff0ff8ef1d85cca3ad5c6574a182e5729417287a"}
Jul 24 01:57:38.429267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.429148    2568 scope.go:117] "RemoveContainer" containerID="dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4"
Jul 24 01:57:38.438932 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.438915    2568 scope.go:117] "RemoveContainer" containerID="cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"
Jul 24 01:57:38.446950 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.446931    2568 scope.go:117] "RemoveContainer" containerID="dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4"
Jul 24 01:57:38.447213 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:57:38.447194    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4\": container with ID starting with dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4 not found: ID does not exist" containerID="dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4"
Jul 24 01:57:38.447290 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.447226    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4"} err="failed to get container status \"dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4\": rpc error: code = NotFound desc = could not find container \"dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4\": container with ID starting with dc1b4f16ba9d4c30acd0610ea418941707867d7f46b9341b34ec543f81d821b4 not found: ID does not exist"
Jul 24 01:57:38.447290 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.447251    2568 scope.go:117] "RemoveContainer" containerID="cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"
Jul 24 01:57:38.447521 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:57:38.447504    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5\": container with ID starting with cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5 not found: ID does not exist" containerID="cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"
Jul 24 01:57:38.447564 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.447527    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5"} err="failed to get container status \"cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5\": rpc error: code = NotFound desc = could not find container \"cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5\": container with ID starting with cfd87efcb1efd391dcd16b8db6144f2f6e78bba71368063d1f408ab4b41596e5 not found: ID does not exist"
Jul 24 01:57:38.451022 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.451002    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"]
Jul 24 01:57:38.454052 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:38.454032    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-44fb0de5-openshift-default-69cfb757b4-54hv6"]
Jul 24 01:57:39.504616 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:39.504583    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" path="/var/lib/kubelet/pods/5df09ee3-1c77-47d8-bca8-56325ddb345c/volumes"
Jul 24 01:57:42.584626 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:42.584586    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:57:51.418380 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.418341    2568 patch_prober.go:28] interesting pod/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 24 01:57:51.418877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.418415    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 24 01:57:51.493458 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.493424    2568 generic.go:356] "Generic (PLEG): container finished" podID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerID="f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d" exitCode=0
Jul 24 01:57:51.493621 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.493497    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" event={"ID":"95af8f6e-22cb-4d64-bcdf-291c5634a609","Type":"ContainerDied","Data":"f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"}
Jul 24 01:57:51.493958 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.493942    2568 scope.go:117] "RemoveContainer" containerID="f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"
Jul 24 01:57:51.494914 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.494882    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:51.495008 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.494955    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:51.495008 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:51.494995    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:57:52.500345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:52.500309    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" event={"ID":"95af8f6e-22cb-4d64-bcdf-291c5634a609","Type":"ContainerStarted","Data":"7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25"}
Jul 24 01:57:52.802655 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:52.802568    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:52.802817 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:52.802795    2568 patch_prober.go:28] interesting pod/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 24 01:57:52.802874 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:52.802856    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 24 01:57:53.802773 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:53.802736    2568 patch_prober.go:28] interesting pod/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 24 01:57:53.803171 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:53.802789    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 24 01:57:54.803047 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:54.803013    2568 patch_prober.go:28] interesting pod/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 24 01:57:54.803456 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:54.803078    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 24 01:57:55.802490 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:55.802458    2568 patch_prober.go:28] interesting pod/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 24 01:57:55.802672 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:55.802515    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 24 01:57:56.806746 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:56.806717    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:56.807197 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:56.807049    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:57:56.807755 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:57:56.807737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:58:11.370815 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:11.370737    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:11.435740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:11.435709    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:11.490915 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:11.490865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:14.184679 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:14.184646    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:58:16.020634 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.020592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:16.170744 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.170714    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"]
Jul 24 01:58:16.170954 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.170926    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy" containerID="cri-o://7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25" gracePeriod=30
Jul 24 01:58:16.195334 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.195299    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:16.440910 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.440884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:16.673943 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.673913    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:16.994697 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:16.994668    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:17.092748 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:17.092667    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:19.854508 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:19.854473    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:19.961982 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:19.961945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:20.127484 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:20.127390    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:20.623447 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:20.623417    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:20.721316 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:20.721283    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:21.127997 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.127964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:21.423550 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.423526    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:58:21.478417 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478387    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95af8f6e-22cb-4d64-bcdf-291c5634a609-istiod-ca-cert\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478417 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478422    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-credential-socket\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478459    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-socket\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478603    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-podinfo\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478674 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478654    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-data\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478809 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478683    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-envoy\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478809 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478716    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-certs\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478809 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:58:21.478951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478808    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:58:21.478951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478843    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99xt6\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-kube-api-access-99xt6\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-token\") pod \"95af8f6e-22cb-4d64-bcdf-291c5634a609\" (UID: \"95af8f6e-22cb-4d64-bcdf-291c5634a609\") "
Jul 24 01:58:21.478951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.478933    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:58:21.479163 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.479132    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95af8f6e-22cb-4d64-bcdf-291c5634a609-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:58:21.479306 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.479251    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95af8f6e-22cb-4d64-bcdf-291c5634a609-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.479306 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.479271    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.479306 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.479285    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.479306 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.479298    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.479517 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.479442    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-data" (OuterVolumeSpecName: "istio-data") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:58:21.480880 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.480836    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:58:21.480983 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.480964    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-kube-api-access-99xt6" (OuterVolumeSpecName: "kube-api-access-99xt6") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "kube-api-access-99xt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:58:21.481110 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.481074    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 01:58:21.481234 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.481187    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-token" (OuterVolumeSpecName: "istio-token") pod "95af8f6e-22cb-4d64-bcdf-291c5634a609" (UID: "95af8f6e-22cb-4d64-bcdf-291c5634a609"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:58:21.580988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.580955    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99xt6\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-kube-api-access-99xt6\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.580988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.580983    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.580988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.580994    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.580988 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.581001    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.581380 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.581009    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95af8f6e-22cb-4d64-bcdf-291c5634a609-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:21.636087 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.636056    2568 generic.go:356] "Generic (PLEG): container finished" podID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerID="7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25" exitCode=0
Jul 24 01:58:21.636268 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.636110    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"
Jul 24 01:58:21.636268 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.636152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" event={"ID":"95af8f6e-22cb-4d64-bcdf-291c5634a609","Type":"ContainerDied","Data":"7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25"}
Jul 24 01:58:21.636268 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.636233    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5" event={"ID":"95af8f6e-22cb-4d64-bcdf-291c5634a609","Type":"ContainerDied","Data":"230888a0b049dc7659a5400dcdff56fd0d4c00c21b428c700f32acac41478e2f"}
Jul 24 01:58:21.636268 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.636257    2568 scope.go:117] "RemoveContainer" containerID="7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25"
Jul 24 01:58:21.645420 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.645405    2568 scope.go:117] "RemoveContainer" containerID="f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"
Jul 24 01:58:21.654290 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.654201    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"]
Jul 24 01:58:21.654719 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.654704    2568 scope.go:117] "RemoveContainer" containerID="7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25"
Jul 24 01:58:21.654995 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:58:21.654977    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25\": container with ID starting with 7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25 not found: ID does not exist" containerID="7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25"
Jul 24 01:58:21.655080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.655003    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25"} err="failed to get container status \"7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25\": rpc error: code = NotFound desc = could not find container \"7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25\": container with ID starting with 7fb62d4f1401cabace073518711fe7da201f5e1f4eace86010247cad33615a25 not found: ID does not exist"
Jul 24 01:58:21.655080 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.655023    2568 scope.go:117] "RemoveContainer" containerID="f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"
Jul 24 01:58:21.655280 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:58:21.655261    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d\": container with ID starting with f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d not found: ID does not exist" containerID="f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"
Jul 24 01:58:21.655345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.655287    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d"} err="failed to get container status \"f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d\": rpc error: code = NotFound desc = could not find container \"f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d\": container with ID starting with f6412adb3c99c19b362c151eb0cd2c7da17449812a4f2587d8201be29b77597d not found: ID does not exist"
Jul 24 01:58:21.656115 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:21.656094    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3d183c95-gw-openshift-default-85bb7fb74d-2ppx5"]
Jul 24 01:58:23.505558 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:23.505528    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" path="/var/lib/kubelet/pods/95af8f6e-22cb-4d64-bcdf-291c5634a609/volumes"
Jul 24 01:58:25.589317 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:25.589282    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:58:45.773212 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773164    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"]
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773548    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773559    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773575    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773581    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773589    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773595    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773661    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773669    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy"
Jul 24 01:58:45.773699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.773677    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95af8f6e-22cb-4d64-bcdf-291c5634a609" containerName="istio-proxy"
Jul 24 01:58:45.777952 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.777934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:45.780261 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.780240    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcl7q\""
Jul 24 01:58:45.780572 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.780557    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 01:58:45.784812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.784787    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"]
Jul 24 01:58:45.814812 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.814781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e937fa8c-6cde-4430-b44d-12ce90fa2505-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c\" (UID: \"e937fa8c-6cde-4430-b44d-12ce90fa2505\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:45.916282 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.916243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e937fa8c-6cde-4430-b44d-12ce90fa2505-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c\" (UID: \"e937fa8c-6cde-4430-b44d-12ce90fa2505\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:45.916851 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:45.916831    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e937fa8c-6cde-4430-b44d-12ce90fa2505-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c\" (UID: \"e937fa8c-6cde-4430-b44d-12ce90fa2505\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:46.089816 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:46.089726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:46.217896 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:46.217871    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"]
Jul 24 01:58:46.220536 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:58:46.220510    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode937fa8c_6cde_4430_b44d_12ce90fa2505.slice/crio-414da7a925af8fccfe0f534ba7c9b993a4a9c0b9b1f63b64170292fdd4439be1 WatchSource:0}: Error finding container 414da7a925af8fccfe0f534ba7c9b993a4a9c0b9b1f63b64170292fdd4439be1: Status 404 returned error can't find the container with id 414da7a925af8fccfe0f534ba7c9b993a4a9c0b9b1f63b64170292fdd4439be1
Jul 24 01:58:46.222502 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:46.222476    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 01:58:46.755526 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:46.755494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c" event={"ID":"e937fa8c-6cde-4430-b44d-12ce90fa2505","Type":"ContainerStarted","Data":"414da7a925af8fccfe0f534ba7c9b993a4a9c0b9b1f63b64170292fdd4439be1"}
Jul 24 01:58:49.771977 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:49.771941    2568 generic.go:356] "Generic (PLEG): container finished" podID="e937fa8c-6cde-4430-b44d-12ce90fa2505" containerID="740372f4a5112599807e6d3a86922f681db1bac86ec8f3c1e716483b0273daae" exitCode=0
Jul 24 01:58:49.772401 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:49.772034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c" event={"ID":"e937fa8c-6cde-4430-b44d-12ce90fa2505","Type":"ContainerDied","Data":"740372f4a5112599807e6d3a86922f681db1bac86ec8f3c1e716483b0273daae"}
Jul 24 01:58:50.920820 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:50.920793    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:50.964210 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:50.964166    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e937fa8c-6cde-4430-b44d-12ce90fa2505-maas-api-service-ca\") pod \"e937fa8c-6cde-4430-b44d-12ce90fa2505\" (UID: \"e937fa8c-6cde-4430-b44d-12ce90fa2505\") "
Jul 24 01:58:50.964471 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:50.964448    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e937fa8c-6cde-4430-b44d-12ce90fa2505-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e937fa8c-6cde-4430-b44d-12ce90fa2505" (UID: "e937fa8c-6cde-4430-b44d-12ce90fa2505"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:58:51.065650 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:51.065565    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e937fa8c-6cde-4430-b44d-12ce90fa2505-maas-api-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:58:51.782439 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:51.782367    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"
Jul 24 01:58:51.782439 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:51.782370    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c" event={"ID":"e937fa8c-6cde-4430-b44d-12ce90fa2505","Type":"ContainerDied","Data":"414da7a925af8fccfe0f534ba7c9b993a4a9c0b9b1f63b64170292fdd4439be1"}
Jul 24 01:58:51.782439 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:51.782414    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="414da7a925af8fccfe0f534ba7c9b993a4a9c0b9b1f63b64170292fdd4439be1"
Jul 24 01:58:56.241961 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:56.241931    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:56.337740 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:56.337709    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:56.437352 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:56.437312    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:58:58.986951 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:58:58.986914    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:59:00.858340 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:00.858307    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:00.859115 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:00.859095    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"]
Jul 24 01:59:00.862014 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:00.861992    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da5bdfda-mx55c"]
Jul 24 01:59:01.504617 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:01.504580    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e937fa8c-6cde-4430-b44d-12ce90fa2505" path="/var/lib/kubelet/pods/e937fa8c-6cde-4430-b44d-12ce90fa2505/volumes"
Jul 24 01:59:02.302317 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.302274    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:02.404325 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.404288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:02.637897 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.637779    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:02.905906 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.905824    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"]
Jul 24 01:59:02.906273 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.906259    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e937fa8c-6cde-4430-b44d-12ce90fa2505" containerName="revoke-keys"
Jul 24 01:59:02.906327 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.906274    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e937fa8c-6cde-4430-b44d-12ce90fa2505" containerName="revoke-keys"
Jul 24 01:59:02.906327 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.906292    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy"
Jul 24 01:59:02.906327 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.906298    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy"
Jul 24 01:59:02.906421 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.906355    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e937fa8c-6cde-4430-b44d-12ce90fa2505" containerName="revoke-keys"
Jul 24 01:59:02.906421 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.906367    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df09ee3-1c77-47d8-bca8-56325ddb345c" containerName="istio-proxy"
Jul 24 01:59:02.909784 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.909765    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.912609 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.912586    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d1346920-openshift-default-dockercfg-8bhq4\""
Jul 24 01:59:02.924814 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.924793    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"]
Jul 24 01:59:02.937879 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.937847    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:02.980502 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-envoy\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980502 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-socket\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-token\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qpb\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-kube-api-access-x2qpb\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980699 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980613    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-podinfo\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-certs\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-data\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-credential-socket\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:02.980799 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:02.980788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05569f1c-281e-4472-a6f5-8bf8f716abc3-istiod-ca-cert\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.081858 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.081815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-certs\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.081858 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.081866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-data\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.081906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-credential-socket\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.081923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05569f1c-281e-4472-a6f5-8bf8f716abc3-istiod-ca-cert\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.081949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-envoy\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.081968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-socket\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082011    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-token\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qpb\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-kube-api-access-x2qpb\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082118 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-podinfo\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082525 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082290    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-certs\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082525 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-credential-socket\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082525 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-socket\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082753 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-data\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.082753 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.082686    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05569f1c-281e-4472-a6f5-8bf8f716abc3-istiod-ca-cert\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.084309 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.084288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-envoy\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.084587 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.084566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-podinfo\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.090421 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.090395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-token\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.090549 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.090532    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qpb\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-kube-api-access-x2qpb\") pod \"e2e-derive-d1346920-openshift-default-57654d769b-6psbd\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") " pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.219863 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.219833    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:03.239664 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.239587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:03.385418 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.385389    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"]
Jul 24 01:59:03.387311 ip-10-0-142-39 kubenswrapper[2568]: W0724 01:59:03.387283    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05569f1c_281e_4472_a6f5_8bf8f716abc3.slice/crio-8472b126c96a78d65955a662854789c6ef2a7d85c325ce96090acaad37891494 WatchSource:0}: Error finding container 8472b126c96a78d65955a662854789c6ef2a7d85c325ce96090acaad37891494: Status 404 returned error can't find the container with id 8472b126c96a78d65955a662854789c6ef2a7d85c325ce96090acaad37891494
Jul 24 01:59:03.389451 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.389414    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:59:03.389527 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.389510    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:59:03.389599 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.389582    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:59:03.843496 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.843461    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" event={"ID":"05569f1c-281e-4472-a6f5-8bf8f716abc3","Type":"ContainerStarted","Data":"6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"}
Jul 24 01:59:03.843696 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.843515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" event={"ID":"05569f1c-281e-4472-a6f5-8bf8f716abc3","Type":"ContainerStarted","Data":"8472b126c96a78d65955a662854789c6ef2a7d85c325ce96090acaad37891494"}
Jul 24 01:59:03.865263 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:03.865214    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" podStartSLOduration=1.865200003 podStartE2EDuration="1.865200003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 01:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 01:59:03.862704564 +0000 UTC m=+1756.887103040" watchObservedRunningTime="2026-07-24 01:59:03.865200003 +0000 UTC m=+1756.889598470"
Jul 24 01:59:04.220631 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:04.220602    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:04.225428 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:04.225407    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:04.849313 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:04.849284    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:04.850253 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:04.850234    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:05.217267 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:05.217230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:05.291863 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:05.291834    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:05.367101 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:05.367072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:05.602571 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:05.602486    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:05.906065 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:05.905984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:06.006394 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:06.006363    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:07.884145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:07.884107    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:59:15.909642 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:15.909608    2568 generic.go:356] "Generic (PLEG): container finished" podID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerID="6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f" exitCode=0
Jul 24 01:59:15.910081 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:15.909680    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" event={"ID":"05569f1c-281e-4472-a6f5-8bf8f716abc3","Type":"ContainerDied","Data":"6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"}
Jul 24 01:59:15.910231 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:15.910213    2568 scope.go:117] "RemoveContainer" containerID="6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"
Jul 24 01:59:15.911399 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:15.911370    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:59:15.911467 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:15.911441    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:59:15.911511 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:15.911473    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 01:59:16.916398 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:16.916359    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" event={"ID":"05569f1c-281e-4472-a6f5-8bf8f716abc3","Type":"ContainerStarted","Data":"9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976"}
Jul 24 01:59:17.220749 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:17.220714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:17.221727 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:17.221700    2568 patch_prober.go:28] interesting pod/e2e-derive-d1346920-openshift-default-57654d769b-6psbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 01:59:17.221868 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:17.221755    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 01:59:18.220491 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:18.220456    2568 patch_prober.go:28] interesting pod/e2e-derive-d1346920-openshift-default-57654d769b-6psbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 01:59:18.220893 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:18.220526    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 01:59:19.221081 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:19.221047    2568 patch_prober.go:28] interesting pod/e2e-derive-d1346920-openshift-default-57654d769b-6psbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 01:59:19.221495 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:19.221105    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 01:59:19.849762 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:19.849727    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:20.220380 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:20.220342    2568 patch_prober.go:28] interesting pod/e2e-derive-d1346920-openshift-default-57654d769b-6psbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 01:59:20.220547 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:20.220429    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 01:59:21.224413 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:21.224384    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:21.225304 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:21.225287    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:40.714480 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:40.714388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:40.779861 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:40.779827    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:40.850250 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:40.850215    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:43.587265 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:43.587234    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 01:59:45.201899 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:45.201865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:45.430560 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:45.430526    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"]
Jul 24 01:59:45.430804 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:45.430759    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy" containerID="cri-o://9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976" gracePeriod=30
Jul 24 01:59:45.475723 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:45.475623    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:45.658279 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:45.658246    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:46.157554 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:46.157500    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:46.255552 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:46.255519    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:46.359784 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:46.359743    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:47.847211 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:47.847163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:50.690010 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.689986    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:50.836345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836262    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-data\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836311    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-token\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836345 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836344    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-envoy\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836376    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-credential-socket\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836423    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-socket\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836450    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05569f1c-281e-4472-a6f5-8bf8f716abc3-istiod-ca-cert\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836528    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-certs\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836624 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2qpb\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-kube-api-access-x2qpb\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836626    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-podinfo\") pod \"05569f1c-281e-4472-a6f5-8bf8f716abc3\" (UID: \"05569f1c-281e-4472-a6f5-8bf8f716abc3\") "
Jul 24 01:59:50.836877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836676    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:59:50.836877 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836710    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:59:50.837050 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.836939    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:59:50.837050 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.837017    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.837050 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.837039    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.837258 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.837055    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.837258 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.837243    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:59:50.837374 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.837300    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05569f1c-281e-4472-a6f5-8bf8f716abc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 01:59:50.838830 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.838793    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 01:59:50.838937 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.838810    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:59:50.838937 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.838929    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 01:59:50.839129 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.839107    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-kube-api-access-x2qpb" (OuterVolumeSpecName: "kube-api-access-x2qpb") pod "05569f1c-281e-4472-a6f5-8bf8f716abc3" (UID: "05569f1c-281e-4472-a6f5-8bf8f716abc3"). InnerVolumeSpecName "kube-api-access-x2qpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 01:59:50.937726 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.937690    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05569f1c-281e-4472-a6f5-8bf8f716abc3-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.937726 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.937721    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2qpb\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-kube-api-access-x2qpb\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.937726 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.937731    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.937963 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.937741    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.937963 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.937749    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:50.937963 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:50.937756    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05569f1c-281e-4472-a6f5-8bf8f716abc3-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 01:59:51.120368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.120282    2568 generic.go:356] "Generic (PLEG): container finished" podID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerID="9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976" exitCode=0
Jul 24 01:59:51.120368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.120338    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" event={"ID":"05569f1c-281e-4472-a6f5-8bf8f716abc3","Type":"ContainerDied","Data":"9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976"}
Jul 24 01:59:51.120368 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.120348    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"
Jul 24 01:59:51.120592 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.120409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd" event={"ID":"05569f1c-281e-4472-a6f5-8bf8f716abc3","Type":"ContainerDied","Data":"8472b126c96a78d65955a662854789c6ef2a7d85c325ce96090acaad37891494"}
Jul 24 01:59:51.120592 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.120432    2568 scope.go:117] "RemoveContainer" containerID="9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976"
Jul 24 01:59:51.129805 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.129780    2568 scope.go:117] "RemoveContainer" containerID="6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"
Jul 24 01:59:51.137946 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.137927    2568 scope.go:117] "RemoveContainer" containerID="9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976"
Jul 24 01:59:51.138220 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:59:51.138201    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976\": container with ID starting with 9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976 not found: ID does not exist" containerID="9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976"
Jul 24 01:59:51.138280 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.138228    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976"} err="failed to get container status \"9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976\": rpc error: code = NotFound desc = could not find container \"9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976\": container with ID starting with 9fcf4232d12e813362b9999dcea22653b8782c22404ae6db5cf737b66bc84976 not found: ID does not exist"
Jul 24 01:59:51.138280 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.138242    2568 scope.go:117] "RemoveContainer" containerID="6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"
Jul 24 01:59:51.138479 ip-10-0-142-39 kubenswrapper[2568]: E0724 01:59:51.138465    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f\": container with ID starting with 6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f not found: ID does not exist" containerID="6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"
Jul 24 01:59:51.138522 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.138482    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f"} err="failed to get container status \"6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f\": rpc error: code = NotFound desc = could not find container \"6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f\": container with ID starting with 6c337fa0edbf9ebd6334690105cc4f33cc90777ddf736152a21bc78acb153f8f not found: ID does not exist"
Jul 24 01:59:51.141887 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.141867    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"]
Jul 24 01:59:51.145739 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.145719    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d1346920-openshift-default-57654d769b-6psbd"]
Jul 24 01:59:51.505002 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:51.504969    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" path="/var/lib/kubelet/pods/05569f1c-281e-4472-a6f5-8bf8f716abc3/volumes"
Jul 24 01:59:54.320334 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:54.320302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:54.430794 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:54.430764    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:54.522091 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:54.522059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 01:59:54.622145 ip-10-0-142-39 kubenswrapper[2568]: I0724 01:59:54.622056    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:00.175359 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:00.175328    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:26.270557 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:26.270525    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:32.440478 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:32.440432    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:32.542282 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:32.542241    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:32.642156 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:32.642122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:48.640173 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:48.640142    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:54.523411 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:54.523380    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:54.625620 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:54.625584    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:00:54.735710 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:00:54.735674    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:05.295990 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:05.295957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:06.158828 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:06.158796    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:13.425478 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:13.425386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:13.635863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:13.635823    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:13.801057 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:13.801026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:14.741999 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:14.741969    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:14.890916 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:14.890879    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:16.046840 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:16.046804    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:01:16.761499 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:16.761464    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:22.429566 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:22.429529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:22.658688 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:22.658653    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:23.144612 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:23.144572    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:26.496736 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:26.496694    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:01:30.531640 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:30.531599    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:30.630835 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:30.630798    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:30.784653 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:30.784570    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:31.195863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.195829    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"]
Jul 24 02:01:31.196230 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.196218    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy"
Jul 24 02:01:31.196282 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.196232    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy"
Jul 24 02:01:31.196282 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.196248    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy"
Jul 24 02:01:31.196282 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.196253    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy"
Jul 24 02:01:31.196393 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.196315    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy"
Jul 24 02:01:31.199271 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.199251    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.210594 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.210577    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-20b5fb51-openshift-default-dockercfg-kgc2q\""
Jul 24 02:01:31.235978 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.235947    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"]
Jul 24 02:01:31.261777 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.261750    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:31.271728 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-certs\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.271923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271733    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-envoy\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.271923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkh8p\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-kube-api-access-pkh8p\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.271923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-podinfo\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.271923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-credential-socket\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.271923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-data\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.272111 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.271962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7651be5c-68c5-4173-a4c3-207a8abef83b-istiod-ca-cert\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.272111 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.272010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-socket\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.272111 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.272052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-token\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-socket\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-token\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-certs\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-envoy\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkh8p\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-kube-api-access-pkh8p\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-podinfo\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-credential-socket\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373821 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-data\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373821 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-socket\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373821 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-certs\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.373821 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7651be5c-68c5-4173-a4c3-207a8abef83b-istiod-ca-cert\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.374042 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373856    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-data\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.374042 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.373961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-credential-socket\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.374431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.374411    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7651be5c-68c5-4173-a4c3-207a8abef83b-istiod-ca-cert\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.375933 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.375886    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-envoy\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.376076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.376059    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-podinfo\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.386807 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.386787    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-token\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.386967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.386950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkh8p\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-kube-api-access-pkh8p\") pod \"e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") " pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.499695 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.499598    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:31.509148 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.509121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:31.655125 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.655095    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"]
Jul 24 02:01:31.658601 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:01:31.658577    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7651be5c_68c5_4173_a4c3_207a8abef83b.slice/crio-a0395b4d2cf4c7f0499ab87bda33b63e744968d241cbc8e2e19d70d52d3dcb16 WatchSource:0}: Error finding container a0395b4d2cf4c7f0499ab87bda33b63e744968d241cbc8e2e19d70d52d3dcb16: Status 404 returned error can't find the container with id a0395b4d2cf4c7f0499ab87bda33b63e744968d241cbc8e2e19d70d52d3dcb16
Jul 24 02:01:31.660520 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.660490    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:01:31.660584 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.660568    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:01:31.660622 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:31.660598    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:01:32.607755 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:32.607721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" event={"ID":"7651be5c-68c5-4173-a4c3-207a8abef83b","Type":"ContainerStarted","Data":"1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"}
Jul 24 02:01:32.608007 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:32.607772    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" event={"ID":"7651be5c-68c5-4173-a4c3-207a8abef83b","Type":"ContainerStarted","Data":"a0395b4d2cf4c7f0499ab87bda33b63e744968d241cbc8e2e19d70d52d3dcb16"}
Jul 24 02:01:32.647634 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:32.647573    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" podStartSLOduration=1.647558451 podStartE2EDuration="1.647558451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:01:32.645917599 +0000 UTC m=+1905.670316086" watchObservedRunningTime="2026-07-24 02:01:32.647558451 +0000 UTC m=+1905.671956927"
Jul 24 02:01:33.509728 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:33.509691    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:33.514377 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:33.514355    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:33.615936 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:33.615904    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:33.616787 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:33.616770    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:34.693101 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:34.693075    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:34.848562 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:34.848529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:34.956710 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:34.956630    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:35.055997 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:35.055953    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:35.816573 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:35.816542    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:35.980524 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:35.980467    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:39.219758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:39.219723    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:39.422490 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:39.422458    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:01:39.963820 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:39.963785    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:40.083116 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:40.083083    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:40.467580 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:40.467552    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:47.686710 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:47.686623    2568 generic.go:356] "Generic (PLEG): container finished" podID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerID="1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948" exitCode=0
Jul 24 02:01:47.686710 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:47.686685    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" event={"ID":"7651be5c-68c5-4173-a4c3-207a8abef83b","Type":"ContainerDied","Data":"1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"}
Jul 24 02:01:47.687164 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:47.687068    2568 scope.go:117] "RemoveContainer" containerID="1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"
Jul 24 02:01:47.688221 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:47.688195    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:01:47.688318 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:47.688279    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:01:47.688363 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:47.688323    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:01:48.245297 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:48.245268    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:48.381848 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:48.381819    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:48.616609 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:48.616523    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:48.694752 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:48.694714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" event={"ID":"7651be5c-68c5-4173-a4c3-207a8abef83b","Type":"ContainerStarted","Data":"81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e"}
Jul 24 02:01:49.509810 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:49.509775    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:49.510889 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:49.510866    2568 patch_prober.go:28] interesting pod/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 02:01:49.510948 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:49.510915    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 02:01:50.509919 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:50.509878    2568 patch_prober.go:28] interesting pod/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 02:01:50.510334 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:50.509940    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 02:01:51.509928 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:51.509894    2568 patch_prober.go:28] interesting pod/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 02:01:51.510328 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:51.509944    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 02:01:52.510311 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:52.510277    2568 patch_prober.go:28] interesting pod/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 02:01:52.510712 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:52.510331    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 02:01:53.267448 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:53.267416    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:53.513829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:53.513799    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:53.514342 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:53.514129    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:53.514894 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:53.514874    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:01:59.403085 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:59.403050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:59.535370 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:59.535338    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:01:59.657271 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:01:59.657157    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:02.414330 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:02.414297    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:02:03.874881 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:03.874848    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:04.315719 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:04.315684    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:11.171196 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:11.171140    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:11.272502 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:11.272470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:11.494764 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:11.494724    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"]
Jul 24 02:02:11.494983 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:11.494961    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy" containerID="cri-o://81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e" gracePeriod=30
Jul 24 02:02:11.553745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:11.553713    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:11.909367 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:11.909283    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:12.070400 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:12.070369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:12.224331 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:12.224298    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:16.750740 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.750717    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:02:16.819724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819644    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-data\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819706    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7651be5c-68c5-4173-a4c3-207a8abef83b-istiod-ca-cert\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819749    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-podinfo\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819766    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-socket\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819795    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-envoy\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819854    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkh8p\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-kube-api-access-pkh8p\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819880    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-certs\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819915    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-token\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.819961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.819952    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-credential-socket\") pod \"7651be5c-68c5-4173-a4c3-207a8abef83b\" (UID: \"7651be5c-68c5-4173-a4c3-207a8abef83b\") "
Jul 24 02:02:16.820352 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820079    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:02:16.820352 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820166    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7651be5c-68c5-4173-a4c3-207a8abef83b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:02:16.820352 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820300    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:02:16.820499 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820409    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:02:16.820499 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820424    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.820499 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820444    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7651be5c-68c5-4173-a4c3-207a8abef83b-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.820499 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820460    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.820677 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.820558    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:02:16.822011 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.821985    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:02:16.822214 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.822158    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:02:16.822436 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.822411    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:02:16.822530 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.822455    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-kube-api-access-pkh8p" (OuterVolumeSpecName: "kube-api-access-pkh8p") pod "7651be5c-68c5-4173-a4c3-207a8abef83b" (UID: "7651be5c-68c5-4173-a4c3-207a8abef83b"). InnerVolumeSpecName "kube-api-access-pkh8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:02:16.842218 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.842188    2568 generic.go:356] "Generic (PLEG): container finished" podID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerID="81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e" exitCode=0
Jul 24 02:02:16.842357 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.842243    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" event={"ID":"7651be5c-68c5-4173-a4c3-207a8abef83b","Type":"ContainerDied","Data":"81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e"}
Jul 24 02:02:16.842357 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.842248    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"
Jul 24 02:02:16.842357 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.842310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n" event={"ID":"7651be5c-68c5-4173-a4c3-207a8abef83b","Type":"ContainerDied","Data":"a0395b4d2cf4c7f0499ab87bda33b63e744968d241cbc8e2e19d70d52d3dcb16"}
Jul 24 02:02:16.842357 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.842331    2568 scope.go:117] "RemoveContainer" containerID="81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e"
Jul 24 02:02:16.851011 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.850995    2568 scope.go:117] "RemoveContainer" containerID="1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"
Jul 24 02:02:16.858976 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.858961    2568 scope.go:117] "RemoveContainer" containerID="81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e"
Jul 24 02:02:16.859258 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:02:16.859234    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e\": container with ID starting with 81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e not found: ID does not exist" containerID="81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e"
Jul 24 02:02:16.859313 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.859273    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e"} err="failed to get container status \"81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e\": rpc error: code = NotFound desc = could not find container \"81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e\": container with ID starting with 81ea3a1160f02b8902c1b5cdcafb027d22e9f85bfb28d0bdb30bf149520fc39e not found: ID does not exist"
Jul 24 02:02:16.859313 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.859292    2568 scope.go:117] "RemoveContainer" containerID="1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"
Jul 24 02:02:16.859522 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:02:16.859505    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948\": container with ID starting with 1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948 not found: ID does not exist" containerID="1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"
Jul 24 02:02:16.859569 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.859527    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948"} err="failed to get container status \"1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948\": rpc error: code = NotFound desc = could not find container \"1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948\": container with ID starting with 1ff5a7116cfb57748891a3105d7e484ed49ae2f3d4ad30fba50be2ab917ad948 not found: ID does not exist"
Jul 24 02:02:16.866491 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.866472    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"]
Jul 24 02:02:16.872635 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.872612    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-20b5fb51-openshift-default-6fd7f665b-b546n"]
Jul 24 02:02:16.921255 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.921227    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkh8p\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-kube-api-access-pkh8p\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.921255 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.921250    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.921255 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.921261    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.921462 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.921269    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.921462 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.921277    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:16.921462 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:16.921284    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7651be5c-68c5-4173-a4c3-207a8abef83b-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:02:17.505800 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:17.505765    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" path="/var/lib/kubelet/pods/7651be5c-68c5-4173-a4c3-207a8abef83b/volumes"
Jul 24 02:02:19.100976 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:19.100951    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:19.289429 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:19.289392    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:19.427737 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:19.427659    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:19.637653 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:19.637622    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:25.746955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:25.746921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:25.875019 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:25.874987    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:33.102693 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.102655    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:33.427274 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427195    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"]
Jul 24 02:02:33.427597 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427584    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy"
Jul 24 02:02:33.427645 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427599    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy"
Jul 24 02:02:33.427645 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427612    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy"
Jul 24 02:02:33.427645 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427619    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy"
Jul 24 02:02:33.427738 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427694    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy"
Jul 24 02:02:33.427738 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.427706    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="05569f1c-281e-4472-a6f5-8bf8f716abc3" containerName="istio-proxy"
Jul 24 02:02:33.430415 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.430398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.433413 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.433386    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d043f7ca-openshift-default-dockercfg-jdg92\""
Jul 24 02:02:33.463787 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.463760    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"]
Jul 24 02:02:33.482406 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482376    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-token\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482443    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-data\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-credential-socket\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482539    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istiod-ca-cert\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482707 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482567    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-certs\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482707 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-podinfo\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482707 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-envoy\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482867 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fknlz\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-kube-api-access-fknlz\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.482867 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.482778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-socket\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583266 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-data\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583266 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-credential-socket\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583519 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istiod-ca-cert\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583519 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-certs\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583637 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-podinfo\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583637 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-envoy\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fknlz\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-kube-api-access-fknlz\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-credential-socket\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583691    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-socket\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583732    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-data\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583937 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583770    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-token\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.583937 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583818    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-certs\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.584034 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583974    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-socket\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.584034 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.583980    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istiod-ca-cert\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.585921 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.585889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-envoy\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.586117 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.586100    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-podinfo\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.607012 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.606986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fknlz\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-kube-api-access-fknlz\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.607547 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.607526    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-token\") pod \"e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") " pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.741380 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.741345    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:33.893048 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:02:33.893017    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0146bd58_9fb4_4c2e_bc0b_982941c670e8.slice/crio-95fb8bf5569d9b19d2c1d3713cf752b4e2500cae07e60684c5a8fe38178d8ef9 WatchSource:0}: Error finding container 95fb8bf5569d9b19d2c1d3713cf752b4e2500cae07e60684c5a8fe38178d8ef9: Status 404 returned error can't find the container with id 95fb8bf5569d9b19d2c1d3713cf752b4e2500cae07e60684c5a8fe38178d8ef9
Jul 24 02:02:33.893536 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.893513    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"]
Jul 24 02:02:33.895225 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.895165    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:02:33.895327 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.895262    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:02:33.895327 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.895309    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:02:33.925870 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:33.925847    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" event={"ID":"0146bd58-9fb4-4c2e-bc0b-982941c670e8","Type":"ContainerStarted","Data":"95fb8bf5569d9b19d2c1d3713cf752b4e2500cae07e60684c5a8fe38178d8ef9"}
Jul 24 02:02:34.928706 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:34.928669    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:34.934927 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:34.934892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" event={"ID":"0146bd58-9fb4-4c2e-bc0b-982941c670e8","Type":"ContainerStarted","Data":"a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"}
Jul 24 02:02:34.980625 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:34.980568    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" podStartSLOduration=1.980552082 podStartE2EDuration="1.980552082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:02:34.979821874 +0000 UTC m=+1968.004220352" watchObservedRunningTime="2026-07-24 02:02:34.980552082 +0000 UTC m=+1968.004950559"
Jul 24 02:02:35.742334 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:35.742301    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:35.747011 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:35.746988    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:35.940896 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:35.940868    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:35.941917 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:35.941899    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:37.146136 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:37.146100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:37.359719 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:37.359679    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:37.550191 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:37.550138    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:38.064309 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:38.064275    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:38.489869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:38.489841    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:38.691681 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:38.691654    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:41.627986 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:41.627900    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:41.844960 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:41.844929    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:02:50.006446 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.006408    2568 generic.go:356] "Generic (PLEG): container finished" podID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerID="a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69" exitCode=0
Jul 24 02:02:50.006912 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.006481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" event={"ID":"0146bd58-9fb4-4c2e-bc0b-982941c670e8","Type":"ContainerDied","Data":"a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"}
Jul 24 02:02:50.006957 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.006945    2568 scope.go:117] "RemoveContainer" containerID="a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"
Jul 24 02:02:50.007909 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.007881    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:02:50.008002 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.007947    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:02:50.008002 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.007978    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:02:50.941334 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:50.941290    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:51.013918 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:51.013881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" event={"ID":"0146bd58-9fb4-4c2e-bc0b-982941c670e8","Type":"ContainerStarted","Data":"23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27"}
Jul 24 02:02:51.745633 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:51.745555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:51.747025 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:51.746691    2568 patch_prober.go:28] interesting pod/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 02:02:51.747025 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:51.746763    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 02:02:52.742852 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:52.742807    2568 patch_prober.go:28] interesting pod/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 02:02:52.743401 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:52.742899    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 02:02:53.741843 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:53.741796    2568 patch_prober.go:28] interesting pod/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 02:02:53.742066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:53.741882    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 02:02:54.477486 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.477453    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"]
Jul 24 02:02:54.477905 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.477893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7651be5c-68c5-4173-a4c3-207a8abef83b" containerName="istio-proxy"
Jul 24 02:02:54.481111 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.481095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.486007 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.485982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d043f7ca\"/\"default-dockercfg-q68tp\""
Jul 24 02:02:54.486241 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.486069    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d043f7ca\"/\"openshift-service-ca.crt\""
Jul 24 02:02:54.487006 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.486981    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d043f7ca\"/\"e2e-lifecycle-model-d043f7ca-kserve-self-signed-certs\""
Jul 24 02:02:54.487106 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.487042    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d043f7ca\"/\"kube-root-ca.crt\""
Jul 24 02:02:54.499337 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.499315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"]
Jul 24 02:02:54.519022 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.518993    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:02:54.586774 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.586734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52nhx\" (UniqueName: \"kubernetes.io/projected/cf1f4ea2-5673-4b2d-ac88-475e88067da3-kube-api-access-52nhx\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.586990 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.586913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-home\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.587085 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.587058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-model-cache\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.587157 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.587139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tmp-dir\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.587260 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.587242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-dshm\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.587302 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.587273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tls-certs\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.687957 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.687918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tmp-dir\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.687966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-dshm\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tls-certs\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52nhx\" (UniqueName: \"kubernetes.io/projected/cf1f4ea2-5673-4b2d-ac88-475e88067da3-kube-api-access-52nhx\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-home\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688428 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688258    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-model-cache\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688428 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tmp-dir\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688566 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-home\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.688618 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.688603    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-model-cache\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.690415 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.690383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-dshm\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.690557 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.690539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tls-certs\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.698025 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.697998    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52nhx\" (UniqueName: \"kubernetes.io/projected/cf1f4ea2-5673-4b2d-ac88-475e88067da3-kube-api-access-52nhx\") pod \"e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") " pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.742739 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.742170    2568 patch_prober.go:28] interesting pod/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 24 02:02:54.742739 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.742299    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 24 02:02:54.799849 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.799813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:02:54.970815 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:54.970784    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"]
Jul 24 02:02:54.974446 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:02:54.974416    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf1f4ea2_5673_4b2d_ac88_475e88067da3.slice/crio-3e1dcbe1ae98a5ec271ae796dacf2a0c73831aeb3b5362398af0fc7c6c024058 WatchSource:0}: Error finding container 3e1dcbe1ae98a5ec271ae796dacf2a0c73831aeb3b5362398af0fc7c6c024058: Status 404 returned error can't find the container with id 3e1dcbe1ae98a5ec271ae796dacf2a0c73831aeb3b5362398af0fc7c6c024058
Jul 24 02:02:55.038756 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:55.038721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k" event={"ID":"cf1f4ea2-5673-4b2d-ac88-475e88067da3","Type":"ContainerStarted","Data":"3e1dcbe1ae98a5ec271ae796dacf2a0c73831aeb3b5362398af0fc7c6c024058"}
Jul 24 02:02:55.746516 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:55.746479    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:55.746952 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:55.746872    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:55.747434 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:55.747416    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:02:56.045442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:56.045356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k" event={"ID":"cf1f4ea2-5673-4b2d-ac88-475e88067da3","Type":"ContainerStarted","Data":"e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239"}
Jul 24 02:02:56.065919 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:56.065866    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k" podStartSLOduration=2.065850744 podStartE2EDuration="2.065850744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:02:56.064987709 +0000 UTC m=+1989.089386186" watchObservedRunningTime="2026-07-24 02:02:56.065850744 +0000 UTC m=+1989.090249221"
Jul 24 02:02:58.419475 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:02:58.419441    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:03:04.800885 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:04.800841    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:03:04.800885 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:04.800903    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:03:04.813356 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:04.813334    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:03:05.109597 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:05.109509    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:03:11.715244 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:11.715205    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:03:30.592074 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:30.592041    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:03:31.923330 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:31.923295    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:32.033316 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:32.033281    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:32.132518 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:32.132488    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:36.491079 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:36.491043    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:39.089964 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:39.089927    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:03:39.859118 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:39.859086    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:44.842679 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:44.842642    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"]
Jul 24 02:03:44.943678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:44.943643    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:46.953732 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:46.953701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:50.490367 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:50.490334    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:50.545758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:50.545722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:03:59.861593 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:03:59.861473    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k" podUID="cf1f4ea2-5673-4b2d-ac88-475e88067da3" containerName="main" containerID="cri-o://e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239" gracePeriod=45
Jul 24 02:04:00.109717 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.109686    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:04:00.236678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236623    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-home\") pod \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") "
Jul 24 02:04:00.236678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236689    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52nhx\" (UniqueName: \"kubernetes.io/projected/cf1f4ea2-5673-4b2d-ac88-475e88067da3-kube-api-access-52nhx\") pod \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") "
Jul 24 02:04:00.236951 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236734    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tmp-dir\") pod \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") "
Jul 24 02:04:00.236951 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236768    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-model-cache\") pod \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") "
Jul 24 02:04:00.236951 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236792    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-dshm\") pod \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") "
Jul 24 02:04:00.236951 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tls-certs\") pod \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\" (UID: \"cf1f4ea2-5673-4b2d-ac88-475e88067da3\") "
Jul 24 02:04:00.237150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.236978    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-home" (OuterVolumeSpecName: "home") pod "cf1f4ea2-5673-4b2d-ac88-475e88067da3" (UID: "cf1f4ea2-5673-4b2d-ac88-475e88067da3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:00.237150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.237015    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf1f4ea2-5673-4b2d-ac88-475e88067da3" (UID: "cf1f4ea2-5673-4b2d-ac88-475e88067da3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:00.237150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.237100    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf1f4ea2-5673-4b2d-ac88-475e88067da3" (UID: "cf1f4ea2-5673-4b2d-ac88-475e88067da3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:00.237333 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.237248    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:00.237333 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.237262    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:00.237333 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.237273    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:00.239500 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.239445    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1f4ea2-5673-4b2d-ac88-475e88067da3-kube-api-access-52nhx" (OuterVolumeSpecName: "kube-api-access-52nhx") pod "cf1f4ea2-5673-4b2d-ac88-475e88067da3" (UID: "cf1f4ea2-5673-4b2d-ac88-475e88067da3"). InnerVolumeSpecName "kube-api-access-52nhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:04:00.239500 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.239453    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-dshm" (OuterVolumeSpecName: "dshm") pod "cf1f4ea2-5673-4b2d-ac88-475e88067da3" (UID: "cf1f4ea2-5673-4b2d-ac88-475e88067da3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:00.239500 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.239493    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf1f4ea2-5673-4b2d-ac88-475e88067da3" (UID: "cf1f4ea2-5673-4b2d-ac88-475e88067da3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:04:00.338576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.338529    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf1f4ea2-5673-4b2d-ac88-475e88067da3-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:00.338576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.338569    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf1f4ea2-5673-4b2d-ac88-475e88067da3-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:00.338576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.338584    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52nhx\" (UniqueName: \"kubernetes.io/projected/cf1f4ea2-5673-4b2d-ac88-475e88067da3-kube-api-access-52nhx\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:00.367711 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.367676    2568 generic.go:356] "Generic (PLEG): container finished" podID="cf1f4ea2-5673-4b2d-ac88-475e88067da3" containerID="e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239" exitCode=0
Jul 24 02:04:00.367863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.367721    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"
Jul 24 02:04:00.367863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.367761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k" event={"ID":"cf1f4ea2-5673-4b2d-ac88-475e88067da3","Type":"ContainerDied","Data":"e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239"}
Jul 24 02:04:00.367863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.367803    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k" event={"ID":"cf1f4ea2-5673-4b2d-ac88-475e88067da3","Type":"ContainerDied","Data":"3e1dcbe1ae98a5ec271ae796dacf2a0c73831aeb3b5362398af0fc7c6c024058"}
Jul 24 02:04:00.367863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.367822    2568 scope.go:117] "RemoveContainer" containerID="e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239"
Jul 24 02:04:00.376940 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.376925    2568 scope.go:117] "RemoveContainer" containerID="e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239"
Jul 24 02:04:00.377227 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:04:00.377209    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239\": container with ID starting with e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239 not found: ID does not exist" containerID="e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239"
Jul 24 02:04:00.377283 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.377236    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239"} err="failed to get container status \"e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239\": rpc error: code = NotFound desc = could not find container \"e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239\": container with ID starting with e121429ddace4b7ead220176614d1612077f5dd501e57796b4e512f90304b239 not found: ID does not exist"
Jul 24 02:04:00.389374 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.389350    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"]
Jul 24 02:04:00.393813 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:00.393792    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d043f7ca/e2e-lifecycle-model-d043f7ca-kserve-58b9d674c9-fw92k"]
Jul 24 02:04:01.505494 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:01.505458    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1f4ea2-5673-4b2d-ac88-475e88067da3" path="/var/lib/kubelet/pods/cf1f4ea2-5673-4b2d-ac88-475e88067da3/volumes"
Jul 24 02:04:20.601959 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:20.601910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:21.625548 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:21.625510    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:21.994802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:21.994768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:27.550046 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:27.550013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:27.696155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:27.696119    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:27.782487 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:27.782451    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"]
Jul 24 02:04:27.782716 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:27.782690    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy" containerID="cri-o://23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27" gracePeriod=30
Jul 24 02:04:27.809536 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:27.809461    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:28.057121 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:28.057083    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:29.179698 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:29.179662    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:29.265111 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:29.265082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:29.365149 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:29.365114    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:30.182343 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:30.182307    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:30.308275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:30.308236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:30.408755 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:30.408722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:31.399201 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:31.399152    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:04:31.871020 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:31.870986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:33.031555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.031533    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:04:33.145410 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145327    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-envoy\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145410 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-token\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145445    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-credential-socket\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145475    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fknlz\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-kube-api-access-fknlz\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145517    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-socket\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145552    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-data\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145578    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istiod-ca-cert\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145601    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-certs\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.145926 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145766    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:33.145988 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145956    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:33.146076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146052    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:33.146138 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146072    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:04:33.146138 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.145784    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-podinfo\") pod \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\" (UID: \"0146bd58-9fb4-4c2e-bc0b-982941c670e8\") "
Jul 24 02:04:33.146488 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146459    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:33.146488 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146480    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.146672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146502    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.146672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146517    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.146672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.146531    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.147765 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.147738    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:04:33.147876 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.147738    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-kube-api-access-fknlz" (OuterVolumeSpecName: "kube-api-access-fknlz") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "kube-api-access-fknlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:04:33.147876 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.147779    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:04:33.148030 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.148007    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0146bd58-9fb4-4c2e-bc0b-982941c670e8" (UID: "0146bd58-9fb4-4c2e-bc0b-982941c670e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:04:33.247882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.247844    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.247882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.247873    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.247882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.247882    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.247882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.247889    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.248147 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.247898    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fknlz\" (UniqueName: \"kubernetes.io/projected/0146bd58-9fb4-4c2e-bc0b-982941c670e8-kube-api-access-fknlz\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:04:33.534418 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.534388    2568 generic.go:356] "Generic (PLEG): container finished" podID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerID="23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27" exitCode=0
Jul 24 02:04:33.534603 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.534425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" event={"ID":"0146bd58-9fb4-4c2e-bc0b-982941c670e8","Type":"ContainerDied","Data":"23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27"}
Jul 24 02:04:33.534603 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.534454    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"
Jul 24 02:04:33.534603 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.534490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7" event={"ID":"0146bd58-9fb4-4c2e-bc0b-982941c670e8","Type":"ContainerDied","Data":"95fb8bf5569d9b19d2c1d3713cf752b4e2500cae07e60684c5a8fe38178d8ef9"}
Jul 24 02:04:33.534603 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.534512    2568 scope.go:117] "RemoveContainer" containerID="23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27"
Jul 24 02:04:33.543320 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.543301    2568 scope.go:117] "RemoveContainer" containerID="a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"
Jul 24 02:04:33.551471 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.551450    2568 scope.go:117] "RemoveContainer" containerID="23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27"
Jul 24 02:04:33.551899 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:04:33.551877    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27\": container with ID starting with 23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27 not found: ID does not exist" containerID="23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27"
Jul 24 02:04:33.552005 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.551905    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27"} err="failed to get container status \"23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27\": rpc error: code = NotFound desc = could not find container \"23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27\": container with ID starting with 23566c5e9e67c01e27da0f8cda831d5b7d8c2762579a45a9f7388a3a2a8fea27 not found: ID does not exist"
Jul 24 02:04:33.552005 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.551923    2568 scope.go:117] "RemoveContainer" containerID="a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"
Jul 24 02:04:33.552165 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:04:33.552142    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69\": container with ID starting with a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69 not found: ID does not exist" containerID="a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"
Jul 24 02:04:33.552276 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.552171    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69"} err="failed to get container status \"a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69\": rpc error: code = NotFound desc = could not find container \"a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69\": container with ID starting with a3ffe2e925fe9d64dcaa443d3bddb8725fdd44ac5c0a6da32bab73c411a69c69 not found: ID does not exist"
Jul 24 02:04:33.563140 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.563113    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"]
Jul 24 02:04:33.569978 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:33.569955    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d043f7ca-openshift-default-7479cb6884-ntrk7"]
Jul 24 02:04:35.505214 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:35.505165    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" path="/var/lib/kubelet/pods/0146bd58-9fb4-4c2e-bc0b-982941c670e8/volumes"
Jul 24 02:04:37.065972 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:37.065940    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:37.165018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:37.164975    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:37.531347 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:37.531315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:37.631123 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:37.631092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:38.207723 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:38.207691    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:40.787851 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:40.787818    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:04:44.427476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:44.427436    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:44.536601 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:44.536563    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:44.634036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:44.634004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:55.206983 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:55.206951    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:04:55.609229 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:04:55.609135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:16.619043 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:16.619007    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:22.945431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:22.945399    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:23.045542 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.045507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:23.360474 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.360386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:23.681153 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681066    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"]
Jul 24 02:05:23.681580 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681561    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy"
Jul 24 02:05:23.681654 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681581    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy"
Jul 24 02:05:23.681654 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681594    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1f4ea2-5673-4b2d-ac88-475e88067da3" containerName="main"
Jul 24 02:05:23.681654 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681601    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1f4ea2-5673-4b2d-ac88-475e88067da3" containerName="main"
Jul 24 02:05:23.681763 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681673    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1f4ea2-5673-4b2d-ac88-475e88067da3" containerName="main"
Jul 24 02:05:23.681763 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681682    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy"
Jul 24 02:05:23.681763 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.681689    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy"
Jul 24 02:05:23.684882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.684863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.687748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.687723    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b9895f-openshift-default-dockercfg-7sjd7\""
Jul 24 02:05:23.696059 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.696039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"]
Jul 24 02:05:23.726108 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.726077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:23.824239 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824204    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b03780a-3188-456c-a1de-8f18ac929d0e-istiod-ca-cert\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-podinfo\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-socket\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824348    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-data\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zntmf\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-kube-api-access-zntmf\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-credential-socket\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824694 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-token\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824694 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-envoy\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.824694 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.824556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-certs\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925533 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-socket\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925713 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-data\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925713 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925608    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zntmf\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-kube-api-access-zntmf\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925713 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-credential-socket\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-token\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-envoy\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-certs\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b03780a-3188-456c-a1de-8f18ac929d0e-istiod-ca-cert\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.925892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-podinfo\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.926153 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.925952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-socket\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.926153 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.926003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-data\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.926353 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.926334    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-certs\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.926544 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.926519    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-credential-socket\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.927050 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.927016    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b03780a-3188-456c-a1de-8f18ac929d0e-istiod-ca-cert\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.928533 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.928514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-envoy\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.928774 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.928753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-podinfo\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.933757 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.933698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zntmf\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-kube-api-access-zntmf\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.934626 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.934603    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-token\") pod \"e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") " pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:23.995055 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:23.995019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:24.078019 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.077980    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:24.134997 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.134962    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"]
Jul 24 02:05:24.138087 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:05:24.138045    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b03780a_3188_456c_a1de_8f18ac929d0e.slice/crio-7853a795d6a89e91cab2093399f005d5067624314224f544f15a4aee5a95de70 WatchSource:0}: Error finding container 7853a795d6a89e91cab2093399f005d5067624314224f544f15a4aee5a95de70: Status 404 returned error can't find the container with id 7853a795d6a89e91cab2093399f005d5067624314224f544f15a4aee5a95de70
Jul 24 02:05:24.140715 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.140678    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:24.140793 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.140771    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:24.140841 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.140814    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:24.787038 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.787008    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" event={"ID":"0b03780a-3188-456c-a1de-8f18ac929d0e","Type":"ContainerStarted","Data":"0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"}
Jul 24 02:05:24.787230 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.787057    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" event={"ID":"0b03780a-3188-456c-a1de-8f18ac929d0e","Type":"ContainerStarted","Data":"7853a795d6a89e91cab2093399f005d5067624314224f544f15a4aee5a95de70"}
Jul 24 02:05:24.808013 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.807959    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podStartSLOduration=1.807942872 podStartE2EDuration="1.807942872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:05:24.805634984 +0000 UTC m=+2137.830033463" watchObservedRunningTime="2026-07-24 02:05:24.807942872 +0000 UTC m=+2137.832341349"
Jul 24 02:05:24.988088 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.988059    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:24.996004 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:24.995978    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:26.000616 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:26.000585    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:26.777147 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:26.777118    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:26.796238 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:26.796210    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:26.797101 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:26.797084    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:26.874126 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:26.874098    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:27.036622 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:27.036536    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:27.128980 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:27.128951    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:27.659247 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:27.659211    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:27.760017 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:27.759987    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:31.312945 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.312912    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:31.689119 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.689089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:31.803319 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.803286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:05:31.980272 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.980188    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"]
Jul 24 02:05:31.980589 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.980575    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy"
Jul 24 02:05:31.980589 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.980590    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0146bd58-9fb4-4c2e-bc0b-982941c670e8" containerName="istio-proxy"
Jul 24 02:05:31.984513 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.984493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:31.987615 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.987576    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2df67f-openshift-default-dockercfg-pmwhz\""
Jul 24 02:05:31.999722 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:31.999698    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"]
Jul 24 02:05:32.012526 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.012499    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:32.102694 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102654    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-socket\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.102882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-envoy\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.102882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102826    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh6lz\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-kube-api-access-xh6lz\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.102882 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-token\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.103032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-credential-socket\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.103032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-certs\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.103032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d40bed4-984a-4a9d-8179-4c524ec4c874-istiod-ca-cert\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.103032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.102993    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-data\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.103032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.103014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-podinfo\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.163500 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.163466    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:32.204163 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-data\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204163 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-podinfo\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-socket\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204240    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-envoy\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh6lz\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-kube-api-access-xh6lz\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204352    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-token\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-credential-socket\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-certs\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204442 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d40bed4-984a-4a9d-8179-4c524ec4c874-istiod-ca-cert\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204820 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-data\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204820 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-socket\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204925 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-credential-socket\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.204925 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.204859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-certs\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.205159 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.205137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d40bed4-984a-4a9d-8179-4c524ec4c874-istiod-ca-cert\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.206503 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.206480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-envoy\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.206727 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.206708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-podinfo\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.216115 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.216089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh6lz\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-kube-api-access-xh6lz\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.216249 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.216235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-token\") pod \"e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") " pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.295480 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.295390    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:32.434511 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.434487    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"]
Jul 24 02:05:32.437063 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:05:32.437029    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d40bed4_984a_4a9d_8179_4c524ec4c874.slice/crio-e2f011e3cc30a0187eaf92cd63097598ee0db5068c82720d100e35a1a21f6342 WatchSource:0}: Error finding container e2f011e3cc30a0187eaf92cd63097598ee0db5068c82720d100e35a1a21f6342: Status 404 returned error can't find the container with id e2f011e3cc30a0187eaf92cd63097598ee0db5068c82720d100e35a1a21f6342
Jul 24 02:05:32.439153 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.439124    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:32.439280 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.439227    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:32.439280 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.439255    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:32.828427 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.828377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" event={"ID":"8d40bed4-984a-4a9d-8179-4c524ec4c874","Type":"ContainerStarted","Data":"26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"}
Jul 24 02:05:32.828767 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.828744    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" event={"ID":"8d40bed4-984a-4a9d-8179-4c524ec4c874","Type":"ContainerStarted","Data":"e2f011e3cc30a0187eaf92cd63097598ee0db5068c82720d100e35a1a21f6342"}
Jul 24 02:05:32.855200 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:32.855121    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podStartSLOduration=1.855102339 podStartE2EDuration="1.855102339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:05:32.854823535 +0000 UTC m=+2145.879222012" watchObservedRunningTime="2026-07-24 02:05:32.855102339 +0000 UTC m=+2145.879500817"
Jul 24 02:05:33.296290 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:33.296253    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:33.301411 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:33.301383    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:33.837012 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:33.836972    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:33.842613 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:33.842585    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:34.795662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:34.795622    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:34.883234 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:34.883202    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:34.965143 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:34.965108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:35.341525 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:35.341489    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:35.602962 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:35.602881    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:35.697883 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:35.697855    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:39.351417 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.351320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:39.880641 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.880607    2568 generic.go:356] "Generic (PLEG): container finished" podID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerID="0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8" exitCode=0
Jul 24 02:05:39.880863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.880681    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" event={"ID":"0b03780a-3188-456c-a1de-8f18ac929d0e","Type":"ContainerDied","Data":"0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"}
Jul 24 02:05:39.881148 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.881133    2568 scope.go:117] "RemoveContainer" containerID="0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"
Jul 24 02:05:39.882270 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.882243    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:39.882344 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.882325    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:39.882394 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:39.882380    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:40.887273 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:40.887239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" event={"ID":"0b03780a-3188-456c-a1de-8f18ac929d0e","Type":"ContainerStarted","Data":"fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40"}
Jul 24 02:05:40.995591 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:40.995542    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:40.996709 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:40.996682    2568 patch_prober.go:28] interesting pod/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 02:05:40.996771 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:40.996737    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 02:05:41.796724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:41.796684    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:41.996367 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:41.996329    2568 patch_prober.go:28] interesting pod/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 02:05:41.996784 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:41.996387    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 02:05:42.995884 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:42.995848    2568 patch_prober.go:28] interesting pod/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 02:05:42.996073 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:42.995906    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 02:05:43.996221 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:43.996161    2568 patch_prober.go:28] interesting pod/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 24 02:05:43.996633 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:43.996243    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 24 02:05:44.999919 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:44.999885    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:45.001224 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:45.001200    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:05:46.918831 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:46.918757    2568 generic.go:356] "Generic (PLEG): container finished" podID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerID="26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda" exitCode=0
Jul 24 02:05:46.918831 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:46.918813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" event={"ID":"8d40bed4-984a-4a9d-8179-4c524ec4c874","Type":"ContainerDied","Data":"26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"}
Jul 24 02:05:46.919286 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:46.919223    2568 scope.go:117] "RemoveContainer" containerID="26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"
Jul 24 02:05:46.920288 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:46.920256    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:46.920381 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:46.920324    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:46.920381 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:46.920354    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:05:47.707565 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:47.707534    2568 scope.go:117] "RemoveContainer" containerID="740372f4a5112599807e6d3a86922f681db1bac86ec8f3c1e716483b0273daae"
Jul 24 02:05:47.795802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:47.795767    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:05:47.924820 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:47.924788    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" event={"ID":"8d40bed4-984a-4a9d-8179-4c524ec4c874","Type":"ContainerStarted","Data":"ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107"}
Jul 24 02:05:48.296349 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.296311    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:48.297491 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.297467    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 02:05:48.297620 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.297522    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 02:05:48.376505 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.376469    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"]
Jul 24 02:05:48.381291 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.381266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.384541 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.384522    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b9895f\"/\"kube-root-ca.crt\""
Jul 24 02:05:48.384722 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.384535    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b9895f\"/\"openshift-service-ca.crt\""
Jul 24 02:05:48.384812 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.384535    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b9895f\"/\"test-model-b9895f-kserve-self-signed-certs\""
Jul 24 02:05:48.384812 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.384583    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b9895f\"/\"default-dockercfg-86r55\""
Jul 24 02:05:48.388544 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.388521    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"]
Jul 24 02:05:48.411664 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.411636    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:05:48.489472 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.489435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jwf\" (UniqueName: \"kubernetes.io/projected/223db0bc-a906-49be-9846-9580a81f8478-kube-api-access-t4jwf\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.489472 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.489477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-tmp-dir\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.489748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.489549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-model-cache\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.489748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.489626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-dshm\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.489748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.489668    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/223db0bc-a906-49be-9846-9580a81f8478-tls-certs\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.489748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.489701    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-home\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.590630 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.590519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jwf\" (UniqueName: \"kubernetes.io/projected/223db0bc-a906-49be-9846-9580a81f8478-kube-api-access-t4jwf\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.590630 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.590575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-tmp-dir\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.590630 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.590611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-model-cache\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.590955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.590652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-dshm\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.590955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.590788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/223db0bc-a906-49be-9846-9580a81f8478-tls-certs\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.590955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.590846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-home\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.591163 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.591142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-tmp-dir\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.591163 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.591158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-model-cache\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.591319 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.591215    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-home\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.592917 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.592894    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-dshm\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.593197 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.593161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/223db0bc-a906-49be-9846-9580a81f8478-tls-certs\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.599677 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.599654    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jwf\" (UniqueName: \"kubernetes.io/projected/223db0bc-a906-49be-9846-9580a81f8478-kube-api-access-t4jwf\") pod \"test-model-b9895f-kserve-65794ddc55-7kvx4\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") " pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.698551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.698514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:48.855275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.852339    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:48.886840 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.886815    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"]
Jul 24 02:05:48.889546 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:05:48.889522    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod223db0bc_a906_49be_9846_9580a81f8478.slice/crio-09c382d253283af7dc5d1074d62be2fce85c0cdc30c5c68c37bf8e2356f16c7e WatchSource:0}: Error finding container 09c382d253283af7dc5d1074d62be2fce85c0cdc30c5c68c37bf8e2356f16c7e: Status 404 returned error can't find the container with id 09c382d253283af7dc5d1074d62be2fce85c0cdc30c5c68c37bf8e2356f16c7e
Jul 24 02:05:48.953783 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:48.953717    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4" event={"ID":"223db0bc-a906-49be-9846-9580a81f8478","Type":"ContainerStarted","Data":"09c382d253283af7dc5d1074d62be2fce85c0cdc30c5c68c37bf8e2356f16c7e"}
Jul 24 02:05:49.296386 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:49.296352    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 02:05:49.296566 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:49.296408    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 02:05:49.967027 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:49.966986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4" event={"ID":"223db0bc-a906-49be-9846-9580a81f8478","Type":"ContainerStarted","Data":"858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1"}
Jul 24 02:05:49.994867 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:49.994819    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4" podStartSLOduration=1.9948050309999998 podStartE2EDuration="1.994805031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:05:49.99326586 +0000 UTC m=+2163.017664337" watchObservedRunningTime="2026-07-24 02:05:49.994805031 +0000 UTC m=+2163.019203542"
Jul 24 02:05:50.296345 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:50.296252    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 02:05:50.296345 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:50.296317    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 02:05:51.296587 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:51.296549    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 24 02:05:51.296987 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:51.296606    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 24 02:05:52.300535 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:52.300503    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:52.301562 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:52.301544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:05:58.698659 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:58.698623    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:58.699171 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:58.698762    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:58.712294 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:58.712267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:05:59.021439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:05:59.021348    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:06:00.095231 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:00.095199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:06:03.368925 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.368879    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"]
Jul 24 02:06:03.372728 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.372708    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.376688 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.376663    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2df67f\"/\"test-model-2df67f-kserve-self-signed-certs\""
Jul 24 02:06:03.376802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.376688    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2df67f\"/\"default-dockercfg-cchfv\""
Jul 24 02:06:03.376802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.376705    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2df67f\"/\"openshift-service-ca.crt\""
Jul 24 02:06:03.376802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.376707    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2df67f\"/\"kube-root-ca.crt\""
Jul 24 02:06:03.383138 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.383119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"]
Jul 24 02:06:03.437364 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.437337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/181cdcfd-46da-47f4-b156-59dabcd2cabb-tls-certs\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.437480 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.437386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-home\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.437480 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.437464    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-tmp-dir\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.437559 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.437510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-model-cache\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.437559 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.437530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9sfp\" (UniqueName: \"kubernetes.io/projected/181cdcfd-46da-47f4-b156-59dabcd2cabb-kube-api-access-n9sfp\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.437624 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.437608    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-dshm\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539140 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-home\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539333 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-tmp-dir\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539333 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539303    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-model-cache\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539460 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539334    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9sfp\" (UniqueName: \"kubernetes.io/projected/181cdcfd-46da-47f4-b156-59dabcd2cabb-kube-api-access-n9sfp\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539460 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-dshm\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539460 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/181cdcfd-46da-47f4-b156-59dabcd2cabb-tls-certs\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539719 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-tmp-dir\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.539849 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.539776    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-home\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.540319 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.540043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-model-cache\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.542309 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.542285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-dshm\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.542483 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.542461    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/181cdcfd-46da-47f4-b156-59dabcd2cabb-tls-certs\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.548103 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.548080    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9sfp\" (UniqueName: \"kubernetes.io/projected/181cdcfd-46da-47f4-b156-59dabcd2cabb-kube-api-access-n9sfp\") pod \"test-model-2df67f-kserve-5fdb76f68c-7mqvm\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") " pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.576006 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.575977    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:06:03.683159 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.683066    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:03.823151 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:03.823121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"]
Jul 24 02:06:03.826258 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:06:03.826232    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod181cdcfd_46da_47f4_b156_59dabcd2cabb.slice/crio-8aa88a8518e5a8a7ad5be97ee0cd10fc64db45c9d08e25a6816aa2c67b5c9d55 WatchSource:0}: Error finding container 8aa88a8518e5a8a7ad5be97ee0cd10fc64db45c9d08e25a6816aa2c67b5c9d55: Status 404 returned error can't find the container with id 8aa88a8518e5a8a7ad5be97ee0cd10fc64db45c9d08e25a6816aa2c67b5c9d55
Jul 24 02:06:04.037548 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:04.037506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm" event={"ID":"181cdcfd-46da-47f4-b156-59dabcd2cabb","Type":"ContainerStarted","Data":"4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1"}
Jul 24 02:06:04.037817 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:04.037557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm" event={"ID":"181cdcfd-46da-47f4-b156-59dabcd2cabb","Type":"ContainerStarted","Data":"8aa88a8518e5a8a7ad5be97ee0cd10fc64db45c9d08e25a6816aa2c67b5c9d55"}
Jul 24 02:06:04.055792 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:04.055678    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm" podStartSLOduration=1.05566042 podStartE2EDuration="1.05566042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:06:04.055516306 +0000 UTC m=+2177.079914782" watchObservedRunningTime="2026-07-24 02:06:04.05566042 +0000 UTC m=+2177.080058897"
Jul 24 02:06:10.595123 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:10.595085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:06:13.683617 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:13.683574    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:13.684026 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:13.683631    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:13.695844 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:13.695819    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:14.098276 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:14.098245    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:06:48.776570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:48.776534    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"]
Jul 24 02:06:48.806666 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:48.806633    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:06:49.860077 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:49.860046    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"]
Jul 24 02:06:49.874284 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:49.874246    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:06:53.583543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:06:53.583508    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:07:00.479548 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:00.479515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:00.548763 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:00.548733    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:00.674288 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:00.674245    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:03.795777 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:03.795731    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4" podUID="223db0bc-a906-49be-9846-9580a81f8478" containerName="main" containerID="cri-o://858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1" gracePeriod=45
Jul 24 02:07:04.053699 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.053640    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:07:04.122837 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.122811    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-tmp-dir\") pod \"223db0bc-a906-49be-9846-9580a81f8478\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") "
Jul 24 02:07:04.123029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.122871    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/223db0bc-a906-49be-9846-9580a81f8478-tls-certs\") pod \"223db0bc-a906-49be-9846-9580a81f8478\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") "
Jul 24 02:07:04.123029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.122943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-home\") pod \"223db0bc-a906-49be-9846-9580a81f8478\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") "
Jul 24 02:07:04.123029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.122991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4jwf\" (UniqueName: \"kubernetes.io/projected/223db0bc-a906-49be-9846-9580a81f8478-kube-api-access-t4jwf\") pod \"223db0bc-a906-49be-9846-9580a81f8478\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") "
Jul 24 02:07:04.123029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123007    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-model-cache\") pod \"223db0bc-a906-49be-9846-9580a81f8478\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") "
Jul 24 02:07:04.123029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123030    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-dshm\") pod \"223db0bc-a906-49be-9846-9580a81f8478\" (UID: \"223db0bc-a906-49be-9846-9580a81f8478\") "
Jul 24 02:07:04.123334 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123067    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "223db0bc-a906-49be-9846-9580a81f8478" (UID: "223db0bc-a906-49be-9846-9580a81f8478"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:04.123334 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123244    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-model-cache" (OuterVolumeSpecName: "model-cache") pod "223db0bc-a906-49be-9846-9580a81f8478" (UID: "223db0bc-a906-49be-9846-9580a81f8478"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:04.123334 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123252    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-home" (OuterVolumeSpecName: "home") pod "223db0bc-a906-49be-9846-9580a81f8478" (UID: "223db0bc-a906-49be-9846-9580a81f8478"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:04.123498 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123396    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:04.123498 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123416    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:04.123498 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.123429    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:04.125188 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.125145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-dshm" (OuterVolumeSpecName: "dshm") pod "223db0bc-a906-49be-9846-9580a81f8478" (UID: "223db0bc-a906-49be-9846-9580a81f8478"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:04.125303 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.125260    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/223db0bc-a906-49be-9846-9580a81f8478-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "223db0bc-a906-49be-9846-9580a81f8478" (UID: "223db0bc-a906-49be-9846-9580a81f8478"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:07:04.125303 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.125278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223db0bc-a906-49be-9846-9580a81f8478-kube-api-access-t4jwf" (OuterVolumeSpecName: "kube-api-access-t4jwf") pod "223db0bc-a906-49be-9846-9580a81f8478" (UID: "223db0bc-a906-49be-9846-9580a81f8478"). InnerVolumeSpecName "kube-api-access-t4jwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:07:04.224076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.224042    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/223db0bc-a906-49be-9846-9580a81f8478-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:04.224076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.224072    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4jwf\" (UniqueName: \"kubernetes.io/projected/223db0bc-a906-49be-9846-9580a81f8478-kube-api-access-t4jwf\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:04.224076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.224080    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/223db0bc-a906-49be-9846-9580a81f8478-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:04.334901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.334811    2568 generic.go:356] "Generic (PLEG): container finished" podID="223db0bc-a906-49be-9846-9580a81f8478" containerID="858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1" exitCode=0
Jul 24 02:07:04.334901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.334855    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"
Jul 24 02:07:04.335112 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.334898    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4" event={"ID":"223db0bc-a906-49be-9846-9580a81f8478","Type":"ContainerDied","Data":"858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1"}
Jul 24 02:07:04.335112 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.334942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4" event={"ID":"223db0bc-a906-49be-9846-9580a81f8478","Type":"ContainerDied","Data":"09c382d253283af7dc5d1074d62be2fce85c0cdc30c5c68c37bf8e2356f16c7e"}
Jul 24 02:07:04.335112 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.334961    2568 scope.go:117] "RemoveContainer" containerID="858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1"
Jul 24 02:07:04.344421 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.344399    2568 scope.go:117] "RemoveContainer" containerID="858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1"
Jul 24 02:07:04.344682 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:07:04.344665    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1\": container with ID starting with 858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1 not found: ID does not exist" containerID="858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1"
Jul 24 02:07:04.344741 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.344691    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1"} err="failed to get container status \"858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1\": rpc error: code = NotFound desc = could not find container \"858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1\": container with ID starting with 858236927b09e0c49f5b55f96d4858cd880b4bc844f934e72ecb19c4d8dcd3f1 not found: ID does not exist"
Jul 24 02:07:04.356924 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.356902    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"]
Jul 24 02:07:04.363844 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.363826    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b9895f/test-model-b9895f-kserve-65794ddc55-7kvx4"]
Jul 24 02:07:04.879062 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:04.879024    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm" podUID="181cdcfd-46da-47f4-b156-59dabcd2cabb" containerName="main" containerID="cri-o://4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1" gracePeriod=45
Jul 24 02:07:05.055454 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.055413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:05.126908 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.126878    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:07:05.234797 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.234762    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-dshm\") pod \"181cdcfd-46da-47f4-b156-59dabcd2cabb\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") "
Jul 24 02:07:05.234979 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.234853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-home\") pod \"181cdcfd-46da-47f4-b156-59dabcd2cabb\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") "
Jul 24 02:07:05.234979 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.234896    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/181cdcfd-46da-47f4-b156-59dabcd2cabb-tls-certs\") pod \"181cdcfd-46da-47f4-b156-59dabcd2cabb\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") "
Jul 24 02:07:05.234979 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.234915    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-tmp-dir\") pod \"181cdcfd-46da-47f4-b156-59dabcd2cabb\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") "
Jul 24 02:07:05.235164 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.234987    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9sfp\" (UniqueName: \"kubernetes.io/projected/181cdcfd-46da-47f4-b156-59dabcd2cabb-kube-api-access-n9sfp\") pod \"181cdcfd-46da-47f4-b156-59dabcd2cabb\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") "
Jul 24 02:07:05.235164 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.235014    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-model-cache\") pod \"181cdcfd-46da-47f4-b156-59dabcd2cabb\" (UID: \"181cdcfd-46da-47f4-b156-59dabcd2cabb\") "
Jul 24 02:07:05.235164 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.235142    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-home" (OuterVolumeSpecName: "home") pod "181cdcfd-46da-47f4-b156-59dabcd2cabb" (UID: "181cdcfd-46da-47f4-b156-59dabcd2cabb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:05.235395 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.235369    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:05.235395 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.235379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "181cdcfd-46da-47f4-b156-59dabcd2cabb" (UID: "181cdcfd-46da-47f4-b156-59dabcd2cabb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:05.235514 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.235493    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-model-cache" (OuterVolumeSpecName: "model-cache") pod "181cdcfd-46da-47f4-b156-59dabcd2cabb" (UID: "181cdcfd-46da-47f4-b156-59dabcd2cabb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:05.237549 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.237521    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/181cdcfd-46da-47f4-b156-59dabcd2cabb-kube-api-access-n9sfp" (OuterVolumeSpecName: "kube-api-access-n9sfp") pod "181cdcfd-46da-47f4-b156-59dabcd2cabb" (UID: "181cdcfd-46da-47f4-b156-59dabcd2cabb"). InnerVolumeSpecName "kube-api-access-n9sfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:07:05.237667 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.237573    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/181cdcfd-46da-47f4-b156-59dabcd2cabb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "181cdcfd-46da-47f4-b156-59dabcd2cabb" (UID: "181cdcfd-46da-47f4-b156-59dabcd2cabb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:07:05.237667 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.237610    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-dshm" (OuterVolumeSpecName: "dshm") pod "181cdcfd-46da-47f4-b156-59dabcd2cabb" (UID: "181cdcfd-46da-47f4-b156-59dabcd2cabb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:05.336724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.336694    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9sfp\" (UniqueName: \"kubernetes.io/projected/181cdcfd-46da-47f4-b156-59dabcd2cabb-kube-api-access-n9sfp\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:05.336724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.336720    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:05.336724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.336730    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:05.336954 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.336738    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/181cdcfd-46da-47f4-b156-59dabcd2cabb-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:05.336954 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.336747    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/181cdcfd-46da-47f4-b156-59dabcd2cabb-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:05.341417 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.341387    2568 generic.go:356] "Generic (PLEG): container finished" podID="181cdcfd-46da-47f4-b156-59dabcd2cabb" containerID="4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1" exitCode=0
Jul 24 02:07:05.341551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.341431    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"
Jul 24 02:07:05.341551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.341469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm" event={"ID":"181cdcfd-46da-47f4-b156-59dabcd2cabb","Type":"ContainerDied","Data":"4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1"}
Jul 24 02:07:05.341551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.341518    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm" event={"ID":"181cdcfd-46da-47f4-b156-59dabcd2cabb","Type":"ContainerDied","Data":"8aa88a8518e5a8a7ad5be97ee0cd10fc64db45c9d08e25a6816aa2c67b5c9d55"}
Jul 24 02:07:05.341551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.341539    2568 scope.go:117] "RemoveContainer" containerID="4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1"
Jul 24 02:07:05.350132 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.350072    2568 scope.go:117] "RemoveContainer" containerID="4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1"
Jul 24 02:07:05.350385 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:07:05.350366    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1\": container with ID starting with 4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1 not found: ID does not exist" containerID="4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1"
Jul 24 02:07:05.350439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.350393    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1"} err="failed to get container status \"4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1\": rpc error: code = NotFound desc = could not find container \"4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1\": container with ID starting with 4a2daf49fc15975965ddec26b3dc65e3c80b6589fc3e839afb56bae67c1d36b1 not found: ID does not exist"
Jul 24 02:07:05.366459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.366433    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"]
Jul 24 02:07:05.371439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.371417    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2df67f/test-model-2df67f-kserve-5fdb76f68c-7mqvm"]
Jul 24 02:07:05.481850 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.481819    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:05.506431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.506353    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="181cdcfd-46da-47f4-b156-59dabcd2cabb" path="/var/lib/kubelet/pods/181cdcfd-46da-47f4-b156-59dabcd2cabb/volumes"
Jul 24 02:07:05.506801 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:05.506788    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="223db0bc-a906-49be-9846-9580a81f8478" path="/var/lib/kubelet/pods/223db0bc-a906-49be-9846-9580a81f8478/volumes"
Jul 24 02:07:09.884859 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:09.884772    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:07:11.334137 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:11.334098    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:11.398315 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:11.398266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:11.608708 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:11.608622    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"]
Jul 24 02:07:11.608908 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:11.608874    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy" containerID="cri-o://fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40" gracePeriod=30
Jul 24 02:07:11.637827 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:11.637772    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:11.876915 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:11.876820    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:15.003198 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:15.003144    2568 patch_prober.go:28] interesting pod/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 02:07:15.003640 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:15.003223    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 02:07:16.868273 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.868168    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:07:16.953911 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.953881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-credential-socket\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.953926    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-token\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.953957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-data\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954005    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-certs\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954038    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zntmf\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-kube-api-access-zntmf\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954076    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b03780a-3188-456c-a1de-8f18ac929d0e-istiod-ca-cert\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954100    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-socket\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-podinfo\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954224    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-envoy\") pod \"0b03780a-3188-456c-a1de-8f18ac929d0e\" (UID: \"0b03780a-3188-456c-a1de-8f18ac929d0e\") "
Jul 24 02:07:16.954439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954251    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:16.954439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954401    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:16.954439 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954413    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:16.954748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954508    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b03780a-3188-456c-a1de-8f18ac929d0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:07:16.954748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954586    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:16.954748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954608    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:16.954748 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.954622    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:16.955205 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.955155    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:16.956407 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.956378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:07:16.956512 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.956490    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-kube-api-access-zntmf" (OuterVolumeSpecName: "kube-api-access-zntmf") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "kube-api-access-zntmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:07:16.956788 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.956769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:16.956788 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:16.956776    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b03780a-3188-456c-a1de-8f18ac929d0e" (UID: "0b03780a-3188-456c-a1de-8f18ac929d0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:07:17.055922 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.055890    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:17.055922 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.055915    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:17.055922 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.055924    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zntmf\" (UniqueName: \"kubernetes.io/projected/0b03780a-3188-456c-a1de-8f18ac929d0e-kube-api-access-zntmf\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:17.055922 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.055933    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b03780a-3188-456c-a1de-8f18ac929d0e-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:17.056216 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.055941    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:17.056216 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.055950    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b03780a-3188-456c-a1de-8f18ac929d0e-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:17.402588 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.402549    2568 generic.go:356] "Generic (PLEG): container finished" podID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerID="fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40" exitCode=0
Jul 24 02:07:17.402789 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.402607    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"
Jul 24 02:07:17.402789 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.402634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" event={"ID":"0b03780a-3188-456c-a1de-8f18ac929d0e","Type":"ContainerDied","Data":"fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40"}
Jul 24 02:07:17.402789 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.402696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc" event={"ID":"0b03780a-3188-456c-a1de-8f18ac929d0e","Type":"ContainerDied","Data":"7853a795d6a89e91cab2093399f005d5067624314224f544f15a4aee5a95de70"}
Jul 24 02:07:17.402789 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.402727    2568 scope.go:117] "RemoveContainer" containerID="fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40"
Jul 24 02:07:17.412586 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.412569    2568 scope.go:117] "RemoveContainer" containerID="0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"
Jul 24 02:07:17.420520 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.420500    2568 scope.go:117] "RemoveContainer" containerID="fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40"
Jul 24 02:07:17.420761 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:07:17.420743    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40\": container with ID starting with fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40 not found: ID does not exist" containerID="fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40"
Jul 24 02:07:17.420816 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.420770    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40"} err="failed to get container status \"fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40\": rpc error: code = NotFound desc = could not find container \"fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40\": container with ID starting with fa281025d068e61028f0b5fcc5ab1a79a199f17c8e9f5def0979288249b5df40 not found: ID does not exist"
Jul 24 02:07:17.420816 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.420787    2568 scope.go:117] "RemoveContainer" containerID="0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"
Jul 24 02:07:17.421048 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:07:17.421028    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8\": container with ID starting with 0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8 not found: ID does not exist" containerID="0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"
Jul 24 02:07:17.421117 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.421057    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8"} err="failed to get container status \"0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8\": rpc error: code = NotFound desc = could not find container \"0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8\": container with ID starting with 0670cfedcd9faf049b6872211b28328614c591a9cdc86960a09b7760ce5a61e8 not found: ID does not exist"
Jul 24 02:07:17.429348 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.429321    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"]
Jul 24 02:07:17.434697 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.434671    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b9895f-openshift-default-bf8dfbfc6-j8nkc"]
Jul 24 02:07:17.506615 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:17.506580    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" path="/var/lib/kubelet/pods/0b03780a-3188-456c-a1de-8f18ac929d0e/volumes"
Jul 24 02:07:22.666680 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:22.666645    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:22.767649 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:22.767618    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:22.824580 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:22.824551    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:25.688529 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:25.688490    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:07:27.101700 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:27.101663    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:27.516044 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:27.515994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:33.625605 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:33.625566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:33.870711 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:33.870673    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"]
Jul 24 02:07:33.870939 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:33.870911    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy" containerID="cri-o://ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107" gracePeriod=30
Jul 24 02:07:33.910210 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:33.910105    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:33.973546 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:33.973516    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:34.134429 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.134390    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:34.506375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.506333    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:34.800960 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.800884    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"]
Jul 24 02:07:34.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801275    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy"
Jul 24 02:07:34.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801286    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy"
Jul 24 02:07:34.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801304    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="181cdcfd-46da-47f4-b156-59dabcd2cabb" containerName="main"
Jul 24 02:07:34.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801309    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="181cdcfd-46da-47f4-b156-59dabcd2cabb" containerName="main"
Jul 24 02:07:34.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801319    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="223db0bc-a906-49be-9846-9580a81f8478" containerName="main"
Jul 24 02:07:34.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801324    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="223db0bc-a906-49be-9846-9580a81f8478" containerName="main"
Jul 24 02:07:34.801537 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801382    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="223db0bc-a906-49be-9846-9580a81f8478" containerName="main"
Jul 24 02:07:34.801537 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801389    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="181cdcfd-46da-47f4-b156-59dabcd2cabb" containerName="main"
Jul 24 02:07:34.801537 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801397    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy"
Jul 24 02:07:34.801537 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.801404    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy"
Jul 24 02:07:34.804704 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.804684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.807370 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.807350    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-834f2e-openshift-default-dockercfg-klmjp\""
Jul 24 02:07:34.815942 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.815920    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"]
Jul 24 02:07:34.824808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.824785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7dh\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-kube-api-access-7c7dh\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.824912 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.824820    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-token\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.824912 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.824843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-envoy\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.824912 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.824903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-podinfo\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.825029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.824951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-credential-socket\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.825029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.824983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istiod-ca-cert\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.825106 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.825038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-certs\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.825106 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.825063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-data\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.825205 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.825141    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-socket\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.836674 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.836628    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:34.925953 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.925921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-credential-socket\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.925981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istiod-ca-cert\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-certs\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-data\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-socket\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7dh\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-kube-api-access-7c7dh\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-token\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-envoy\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-podinfo\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-credential-socket\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926700 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-data\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926807 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-socket\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926867 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istiod-ca-cert\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.926984 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.926965    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-certs\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.928753 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.928724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-podinfo\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.928889 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.928830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-envoy\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.934696 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.934672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7dh\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-kube-api-access-7c7dh\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:34.935400 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:34.935376    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-token\") pod \"e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") " pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:35.115978 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.115870    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:35.260618 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.260593    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"]
Jul 24 02:07:35.262765 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:07:35.262737    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c341e2_a3e1_429b_a8b7_aa68fa5ed0ad.slice/crio-e4dfb978e2726f2cc99bb9ad61976caa77ec9857c09c548edcdb2e43c20fd726 WatchSource:0}: Error finding container e4dfb978e2726f2cc99bb9ad61976caa77ec9857c09c548edcdb2e43c20fd726: Status 404 returned error can't find the container with id e4dfb978e2726f2cc99bb9ad61976caa77ec9857c09c548edcdb2e43c20fd726
Jul 24 02:07:35.264857 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.264826    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:35.264924 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.264892    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:35.264967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.264939    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:35.497190 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.497149    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" event={"ID":"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad","Type":"ContainerStarted","Data":"810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"}
Jul 24 02:07:35.497371 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.497258    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" event={"ID":"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad","Type":"ContainerStarted","Data":"e4dfb978e2726f2cc99bb9ad61976caa77ec9857c09c548edcdb2e43c20fd726"}
Jul 24 02:07:35.525262 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:35.525202    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podStartSLOduration=1.525167674 podStartE2EDuration="1.525167674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:07:35.522261368 +0000 UTC m=+2268.546659847" watchObservedRunningTime="2026-07-24 02:07:35.525167674 +0000 UTC m=+2268.549566153"
Jul 24 02:07:36.116254 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:36.116216    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:36.121110 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:36.121085    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:36.502682 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:36.502648    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:36.503704 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:36.503685    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:36.952899 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:36.952874    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:37.303446 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:37.303354    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 02:07:37.303891 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:37.303434    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 02:07:37.490723 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:37.490679    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:37.577158 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:37.577081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:37.662217 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:37.662158    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:38.131349 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:38.131307    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:38.465924 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:38.465892    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:38.566712 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:38.566681    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:39.121220 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.121193    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:07:39.170745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170657    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-credential-socket\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.170745 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170712    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-envoy\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.170970 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh6lz\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-kube-api-access-xh6lz\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.170970 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170781    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d40bed4-984a-4a9d-8179-4c524ec4c874-istiod-ca-cert\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.170970 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170836    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-token\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.170970 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170874    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-socket\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.170970 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170938    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-data\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.171275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170966    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:39.171275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.170983    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-podinfo\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.171275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171031    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-certs\") pod \"8d40bed4-984a-4a9d-8179-4c524ec4c874\" (UID: \"8d40bed4-984a-4a9d-8179-4c524ec4c874\") "
Jul 24 02:07:39.171449 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171277    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:39.171449 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171429    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d40bed4-984a-4a9d-8179-4c524ec4c874-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:07:39.171556 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171464    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.171556 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171485    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.171677 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171573    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:39.171972 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.171944    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:39.173405 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.173384    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:07:39.173506 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.173382    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:07:39.173506 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.173407    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-kube-api-access-xh6lz" (OuterVolumeSpecName: "kube-api-access-xh6lz") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "kube-api-access-xh6lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:07:39.173636 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.173615    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d40bed4-984a-4a9d-8179-4c524ec4c874" (UID: "8d40bed4-984a-4a9d-8179-4c524ec4c874"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:07:39.272119 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272086    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.272119 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272114    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh6lz\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-kube-api-access-xh6lz\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.272119 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272125    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d40bed4-984a-4a9d-8179-4c524ec4c874-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.272383 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272134    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.272383 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272142    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.272383 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272149    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d40bed4-984a-4a9d-8179-4c524ec4c874-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.272383 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.272157    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d40bed4-984a-4a9d-8179-4c524ec4c874-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:07:39.522683 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.522651    2568 generic.go:356] "Generic (PLEG): container finished" podID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerID="ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107" exitCode=0
Jul 24 02:07:39.523036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.522709    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"
Jul 24 02:07:39.523036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.522730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" event={"ID":"8d40bed4-984a-4a9d-8179-4c524ec4c874","Type":"ContainerDied","Data":"ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107"}
Jul 24 02:07:39.523036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.522803    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g" event={"ID":"8d40bed4-984a-4a9d-8179-4c524ec4c874","Type":"ContainerDied","Data":"e2f011e3cc30a0187eaf92cd63097598ee0db5068c82720d100e35a1a21f6342"}
Jul 24 02:07:39.523036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.522824    2568 scope.go:117] "RemoveContainer" containerID="ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107"
Jul 24 02:07:39.532733 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.532715    2568 scope.go:117] "RemoveContainer" containerID="26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"
Jul 24 02:07:39.540795 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.540778    2568 scope.go:117] "RemoveContainer" containerID="ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107"
Jul 24 02:07:39.541058 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:07:39.541039    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107\": container with ID starting with ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107 not found: ID does not exist" containerID="ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107"
Jul 24 02:07:39.541113 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.541071    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107"} err="failed to get container status \"ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107\": rpc error: code = NotFound desc = could not find container \"ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107\": container with ID starting with ba111d82129196aaf22a7dc8a438c0ebd4ffe92c5b38017a3483ab6e308db107 not found: ID does not exist"
Jul 24 02:07:39.541113 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.541091    2568 scope.go:117] "RemoveContainer" containerID="26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"
Jul 24 02:07:39.541418 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:07:39.541398    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda\": container with ID starting with 26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda not found: ID does not exist" containerID="26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"
Jul 24 02:07:39.541465 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.541423    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda"} err="failed to get container status \"26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda\": rpc error: code = NotFound desc = could not find container \"26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda\": container with ID starting with 26c4981cb7409c60fbd8f0cc52d9274cf08967eae543a958166a35b83c001dda not found: ID does not exist"
Jul 24 02:07:39.550674 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.550642    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"]
Jul 24 02:07:39.553572 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:39.553552    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2df67f-openshift-default-f9bbddbc4-lzw5g"]
Jul 24 02:07:40.611144 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:40.611108    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:07:41.505593 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:41.505564    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" path="/var/lib/kubelet/pods/8d40bed4-984a-4a9d-8179-4c524ec4c874/volumes"
Jul 24 02:07:42.034044 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.034004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:42.551557 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.551505    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:42.849130 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.849039    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"]
Jul 24 02:07:42.849957 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.849933    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy"
Jul 24 02:07:42.850105 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.850092    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy"
Jul 24 02:07:42.850259 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.850246    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy"
Jul 24 02:07:42.850384 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.850369    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy"
Jul 24 02:07:42.850513 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.850501    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy"
Jul 24 02:07:42.850624 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.850613    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b03780a-3188-456c-a1de-8f18ac929d0e" containerName="istio-proxy"
Jul 24 02:07:42.850849 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.850835    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy"
Jul 24 02:07:42.859262 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.855864    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.860232 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.860086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a955c2-openshift-default-dockercfg-rcs9m\""
Jul 24 02:07:42.870286 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.870265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"]
Jul 24 02:07:42.877128 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.877102    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:42.904047 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-data\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ce96c-8627-4f66-bc71-df91d0f07460-istiod-ca-cert\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jmhh\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-kube-api-access-6jmhh\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-envoy\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-certs\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904323 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-credential-socket\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904323 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ce96c-8627-4f66-bc71-df91d0f07460-istio-podinfo\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904393 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-istio-token\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:42.904393 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:42.904366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-socket\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005081 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ce96c-8627-4f66-bc71-df91d0f07460-istio-podinfo\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-istio-token\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-socket\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-data\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ce96c-8627-4f66-bc71-df91d0f07460-istiod-ca-cert\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jmhh\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-kube-api-access-6jmhh\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-envoy\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005521 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005303    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-certs\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005521 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-credential-socket\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005606 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005576    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-socket\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005706 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005687    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-data\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005774 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-credential-socket\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.005874 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.005853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-certs\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.006114 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.006094    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ce96c-8627-4f66-bc71-df91d0f07460-istiod-ca-cert\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.007552 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.007522    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-envoy\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.007686 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.007670    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ce96c-8627-4f66-bc71-df91d0f07460-istio-podinfo\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.013146 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.013127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-istio-token\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.013331 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.013314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jmhh\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-kube-api-access-6jmhh\") pod \"e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") " pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.172843 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.172752    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:43.353206 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.350884    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"]
Jul 24 02:07:43.357957 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.357926    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:43.358037 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.357995    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:43.358037 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.358020    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:43.530222 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.530150    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:43.550290 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.550251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" event={"ID":"778ce96c-8627-4f66-bc71-df91d0f07460","Type":"ContainerStarted","Data":"9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"}
Jul 24 02:07:43.550472 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:43.550321    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" event={"ID":"778ce96c-8627-4f66-bc71-df91d0f07460","Type":"ContainerStarted","Data":"3bdce3a54f7a9e39bad9b571cb2b49bac89744a03f1995365f14077cbe79f89b"}
Jul 24 02:07:44.173255 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:44.173223    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:44.178113 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:44.178087    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:44.200535 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:44.200493    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podStartSLOduration=2.200478112 podStartE2EDuration="2.200478112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:07:43.575242607 +0000 UTC m=+2276.599641083" watchObservedRunningTime="2026-07-24 02:07:44.200478112 +0000 UTC m=+2277.224876588"
Jul 24 02:07:44.556765 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:44.556735    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:44.557720 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:44.557702    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:07:45.586285 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:45.586254    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:45.697237 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:45.697158    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:45.784985 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:45.784955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:46.281823 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:46.281788    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:46.423169 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:46.423126    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:46.518688 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:46.518647    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:49.586570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:49.586541    2568 generic.go:356] "Generic (PLEG): container finished" podID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerID="810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c" exitCode=0
Jul 24 02:07:49.586570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:49.586584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" event={"ID":"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad","Type":"ContainerDied","Data":"810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"}
Jul 24 02:07:49.587081 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:49.586968    2568 scope.go:117] "RemoveContainer" containerID="810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"
Jul 24 02:07:49.588096 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:49.588060    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:49.588222 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:49.588141    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:49.588222 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:49.588193    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:50.082191 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:50.082149    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:07:50.593225 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:50.593164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" event={"ID":"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad","Type":"ContainerStarted","Data":"631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e"}
Jul 24 02:07:51.116382 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:51.116343    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:51.117467 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:51.117437    2568 patch_prober.go:28] interesting pod/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 02:07:51.117605 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:51.117490    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 02:07:51.505094 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:51.505061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:52.116736 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:52.116698    2568 patch_prober.go:28] interesting pod/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 02:07:52.117142 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:52.116767    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 02:07:53.117077 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:53.117041    2568 patch_prober.go:28] interesting pod/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 02:07:53.117529 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:53.117092    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 02:07:54.116582 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:54.116543    2568 patch_prober.go:28] interesting pod/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 02:07:54.116765 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:54.116594    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 02:07:55.120335 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:55.120303    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:55.121255 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:55.121236    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:07:59.558464 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.558427    2568 patch_prober.go:28] interesting pod/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 02:07:59.558905 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.558493    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 02:07:59.640401 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.640368    2568 generic.go:356] "Generic (PLEG): container finished" podID="778ce96c-8627-4f66-bc71-df91d0f07460" containerID="9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341" exitCode=0
Jul 24 02:07:59.640570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.640440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" event={"ID":"778ce96c-8627-4f66-bc71-df91d0f07460","Type":"ContainerDied","Data":"9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"}
Jul 24 02:07:59.640872 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.640857    2568 scope.go:117] "RemoveContainer" containerID="9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"
Jul 24 02:07:59.641854 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.641829    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:59.641917 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.641895    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:59.641953 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.641929    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:07:59.993012 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:07:59.992975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:08:00.650479 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:00.650432    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" event={"ID":"778ce96c-8627-4f66-bc71-df91d0f07460","Type":"ContainerStarted","Data":"d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae"}
Jul 24 02:08:01.173080 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:01.173041    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:08:01.173317 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:01.173295    2568 patch_prober.go:28] interesting pod/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 02:08:01.173412 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:01.173359    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 02:08:02.174114 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:02.174078    2568 patch_prober.go:28] interesting pod/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 02:08:02.174541 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:02.174137    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 02:08:03.173859 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:03.173819    2568 patch_prober.go:28] interesting pod/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 02:08:03.174021 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:03.173875    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 02:08:04.173732 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:04.173695    2568 patch_prober.go:28] interesting pod/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 24 02:08:04.174157 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:04.173758    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 24 02:08:05.177158 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:05.177127    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:08:05.177660 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:05.177521    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:08:05.178199 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:05.178167    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:08:14.154530 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:14.154494    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:14.236973 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:14.236919    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:14.332669 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:14.332635    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:17.506478 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:17.506443    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:08:18.548157 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:18.548123    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:19.009375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:19.009341    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:24.791190 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:24.791143    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:24.856919 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:24.856887    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:25.034065 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:25.034033    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"]
Jul 24 02:08:25.034359 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:25.034281    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy" containerID="cri-o://631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e" gracePeriod=30
Jul 24 02:08:25.058036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:25.057891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:25.123012 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:25.122969    2568 patch_prober.go:28] interesting pod/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 02:08:25.123209 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:25.123078    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 02:08:25.298531 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:25.298497    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:30.282251 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.282226    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:08:30.386575 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386480    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-podinfo\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386575 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386515    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-data\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386575 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386543    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c7dh\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-kube-api-access-7c7dh\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386592    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-credential-socket\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386631    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-envoy\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386695    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istiod-ca-cert\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-socket\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386774    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-token\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.386869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.386801    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-certs\") pod \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\" (UID: \"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad\") "
Jul 24 02:08:30.387215 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.387084    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:08:30.387215 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.387125    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:30.387338 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.387229    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.387338 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.387244    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:30.387447 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.387330    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:30.387447 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.387404    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:30.388865 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.388840    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-kube-api-access-7c7dh" (OuterVolumeSpecName: "kube-api-access-7c7dh") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "kube-api-access-7c7dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:08:30.388974 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.388874    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:30.388974 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.388907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:08:30.389049 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.389024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" (UID: "61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:08:30.488576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488544    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488570    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488578    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488589    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488597    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c7dh\" (UniqueName: \"kubernetes.io/projected/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-kube-api-access-7c7dh\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488607    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488616    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.488808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.488624    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:30.795255 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.795224    2568 generic.go:356] "Generic (PLEG): container finished" podID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerID="631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e" exitCode=0
Jul 24 02:08:30.795418 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.795267    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"
Jul 24 02:08:30.795418 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.795308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" event={"ID":"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad","Type":"ContainerDied","Data":"631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e"}
Jul 24 02:08:30.795418 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.795360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb" event={"ID":"61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad","Type":"ContainerDied","Data":"e4dfb978e2726f2cc99bb9ad61976caa77ec9857c09c548edcdb2e43c20fd726"}
Jul 24 02:08:30.795418 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.795383    2568 scope.go:117] "RemoveContainer" containerID="631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e"
Jul 24 02:08:30.805381 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.805365    2568 scope.go:117] "RemoveContainer" containerID="810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"
Jul 24 02:08:30.815374 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.815353    2568 scope.go:117] "RemoveContainer" containerID="631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e"
Jul 24 02:08:30.815660 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:08:30.815640    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e\": container with ID starting with 631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e not found: ID does not exist" containerID="631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e"
Jul 24 02:08:30.815719 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.815666    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e"} err="failed to get container status \"631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e\": rpc error: code = NotFound desc = could not find container \"631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e\": container with ID starting with 631df8b59a031ac7ef5113001134d85989367076a60f4a029e44709e34adb13e not found: ID does not exist"
Jul 24 02:08:30.815719 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.815683    2568 scope.go:117] "RemoveContainer" containerID="810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"
Jul 24 02:08:30.815924 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:08:30.815909    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c\": container with ID starting with 810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c not found: ID does not exist" containerID="810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"
Jul 24 02:08:30.815971 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.815926    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c"} err="failed to get container status \"810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c\": rpc error: code = NotFound desc = could not find container \"810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c\": container with ID starting with 810f04cb4bfd2e97e90b06a3d0223192e44b9037133fd2d2bbae9b9c9ab4c39c not found: ID does not exist"
Jul 24 02:08:30.819780 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.819754    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"]
Jul 24 02:08:30.827608 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:30.827584    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-834f2e-openshift-default-c4499c876-rd5hb"]
Jul 24 02:08:31.505074 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:31.505040    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" path="/var/lib/kubelet/pods/61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad/volumes"
Jul 24 02:08:41.316978 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:41.316867    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:41.408678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:41.408635    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:41.474147 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:41.474096    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:45.526887 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:45.526857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:45.705064 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:45.705029    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:08:45.933944 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:45.933827    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:51.844606 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:51.844574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:51.948791 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:51.948747    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:52.111131 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:52.111048    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"]
Jul 24 02:08:52.111317 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:52.111289    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy" containerID="cri-o://d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae" gracePeriod=30
Jul 24 02:08:52.148362 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:52.148332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:52.371996 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:52.371907    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:52.736716 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:52.736682    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:53.117436 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:53.117359    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:53.388671 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:53.388580    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:53.573112 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:53.573082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:56.554362 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:56.554323    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:56.653648 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:56.653614    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:56.755218 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:56.755168    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:57.229017 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.228878    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:57.327478 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.327432    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:57.365369 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.365344    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:08:57.421623 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.421548    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:08:57.446995 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.446965    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ce96c-8627-4f66-bc71-df91d0f07460-istio-podinfo\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447132 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-data\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447132 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447053    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-credential-socket\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447262 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447153    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-socket\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447262 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447253    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ce96c-8627-4f66-bc71-df91d0f07460-istiod-ca-cert\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447347 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447283    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-istio-token\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447347 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447323    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jmhh\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-kube-api-access-6jmhh\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447347 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447305    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:57.447492 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447374    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-envoy\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447492 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447401    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-certs\") pod \"778ce96c-8627-4f66-bc71-df91d0f07460\" (UID: \"778ce96c-8627-4f66-bc71-df91d0f07460\") "
Jul 24 02:08:57.447492 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447419    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:57.447649 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447594    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/778ce96c-8627-4f66-bc71-df91d0f07460-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:08:57.447710 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447695    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:57.447901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447842    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ce96c-8627-4f66-bc71-df91d0f07460-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.447901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447851    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-data" (OuterVolumeSpecName: "istio-data") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:57.447901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447867    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.447901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447881    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.447901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.447894    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.449408 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.449383    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/778ce96c-8627-4f66-bc71-df91d0f07460-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:08:57.449408 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.449399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-istio-token" (OuterVolumeSpecName: "istio-token") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:08:57.449532 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.449414    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:08:57.449618 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.449601    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-kube-api-access-6jmhh" (OuterVolumeSpecName: "kube-api-access-6jmhh") pod "778ce96c-8627-4f66-bc71-df91d0f07460" (UID: "778ce96c-8627-4f66-bc71-df91d0f07460"). InnerVolumeSpecName "kube-api-access-6jmhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:08:57.548868 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.548839    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ce96c-8627-4f66-bc71-df91d0f07460-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.548868 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.548868    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.549080 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.548881    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.549080 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.548890    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jmhh\" (UniqueName: \"kubernetes.io/projected/778ce96c-8627-4f66-bc71-df91d0f07460-kube-api-access-6jmhh\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.549080 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.548901    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ce96c-8627-4f66-bc71-df91d0f07460-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:08:57.928730 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.928691    2568 generic.go:356] "Generic (PLEG): container finished" podID="778ce96c-8627-4f66-bc71-df91d0f07460" containerID="d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae" exitCode=0
Jul 24 02:08:57.929235 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.928757    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"
Jul 24 02:08:57.929235 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.928783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" event={"ID":"778ce96c-8627-4f66-bc71-df91d0f07460","Type":"ContainerDied","Data":"d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae"}
Jul 24 02:08:57.929235 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.928844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f" event={"ID":"778ce96c-8627-4f66-bc71-df91d0f07460","Type":"ContainerDied","Data":"3bdce3a54f7a9e39bad9b571cb2b49bac89744a03f1995365f14077cbe79f89b"}
Jul 24 02:08:57.929235 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.928870    2568 scope.go:117] "RemoveContainer" containerID="d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae"
Jul 24 02:08:57.938100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.938083    2568 scope.go:117] "RemoveContainer" containerID="9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"
Jul 24 02:08:57.945858 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.945841    2568 scope.go:117] "RemoveContainer" containerID="d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae"
Jul 24 02:08:57.946108 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:08:57.946090    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae\": container with ID starting with d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae not found: ID does not exist" containerID="d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae"
Jul 24 02:08:57.946171 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.946115    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae"} err="failed to get container status \"d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae\": rpc error: code = NotFound desc = could not find container \"d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae\": container with ID starting with d1ba7319e4ce5424a884ed4320a18ed40859c7ed37f13f839ef97f8a57d531ae not found: ID does not exist"
Jul 24 02:08:57.946171 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.946131    2568 scope.go:117] "RemoveContainer" containerID="9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"
Jul 24 02:08:57.946389 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:08:57.946371    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341\": container with ID starting with 9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341 not found: ID does not exist" containerID="9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"
Jul 24 02:08:57.946431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.946398    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341"} err="failed to get container status \"9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341\": rpc error: code = NotFound desc = could not find container \"9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341\": container with ID starting with 9fb3385a1c0018f3ac81d11379a775072da54cb079d0b8925d541c9c53dd4341 not found: ID does not exist"
Jul 24 02:08:57.950291 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.950269    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"]
Jul 24 02:08:57.954114 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:57.954093    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a955c2-openshift-default-767599dc56-6qt5f"]
Jul 24 02:08:59.505353 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:08:59.505316    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" path="/var/lib/kubelet/pods/778ce96c-8627-4f66-bc71-df91d0f07460/volumes"
Jul 24 02:09:01.095531 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.095495    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:01.439326 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.439294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:01.762852 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.762764    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"]
Jul 24 02:09:01.763235 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763217    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763237    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763253    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763261    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763272    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763280    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763294    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy"
Jul 24 02:09:01.763332 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763302    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy"
Jul 24 02:09:01.763678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763406    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy"
Jul 24 02:09:01.763678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763422    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d40bed4-984a-4a9d-8179-4c524ec4c874" containerName="istio-proxy"
Jul 24 02:09:01.763678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763434    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy"
Jul 24 02:09:01.763678 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.763446    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="778ce96c-8627-4f66-bc71-df91d0f07460" containerName="istio-proxy"
Jul 24 02:09:01.768082 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.768061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.774265 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.774239    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a7fbc1-openshift-default-dockercfg-2q7f8\""
Jul 24 02:09:01.786204 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.786161    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"]
Jul 24 02:09:01.788366 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-data\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788495 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788385    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-envoy\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788495 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-socket\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788495 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-token\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-credential-socket\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788560    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f9bfb0-622f-49c0-8912-afe094261c1e-istiod-ca-cert\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-podinfo\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnqhw\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-kube-api-access-jnqhw\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.788672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.788660    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-certs\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.821523 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.821486    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:01.889202 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-credential-socket\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889202 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f9bfb0-622f-49c0-8912-afe094261c1e-istiod-ca-cert\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889425 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889332    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-podinfo\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889425 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnqhw\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-kube-api-access-jnqhw\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889506 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-certs\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889560 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-data\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889599 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-credential-socket\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889599 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-envoy\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889693 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-socket\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.889693 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-token\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.890030 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.889980    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-certs\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.890030 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.890001    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f9bfb0-622f-49c0-8912-afe094261c1e-istiod-ca-cert\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.890260 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.890034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-socket\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.890260 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.890145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-data\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.891898 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.891876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-podinfo\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.892017 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.892002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-envoy\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.902068 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.902031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnqhw\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-kube-api-access-jnqhw\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.903802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.903773    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-token\") pod \"e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") " pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:01.949933 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:01.949902    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:02.078854 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.078759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:02.220905 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.220878    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"]
Jul 24 02:09:02.222744 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:09:02.222714    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f9bfb0_622f_49c0_8912_afe094261c1e.slice/crio-58189dc81b8c51180e6e0ece05758fcdd39f39a1ed0912056d10113738dea264 WatchSource:0}: Error finding container 58189dc81b8c51180e6e0ece05758fcdd39f39a1ed0912056d10113738dea264: Status 404 returned error can't find the container with id 58189dc81b8c51180e6e0ece05758fcdd39f39a1ed0912056d10113738dea264
Jul 24 02:09:02.224900 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.224866    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:09:02.224973 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.224931    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:09:02.224973 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.224966    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:09:02.956044 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.956009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" event={"ID":"94f9bfb0-622f-49c0-8912-afe094261c1e","Type":"ContainerStarted","Data":"01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"}
Jul 24 02:09:02.956247 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.956066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" event={"ID":"94f9bfb0-622f-49c0-8912-afe094261c1e","Type":"ContainerStarted","Data":"58189dc81b8c51180e6e0ece05758fcdd39f39a1ed0912056d10113738dea264"}
Jul 24 02:09:02.990105 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:02.990052    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podStartSLOduration=1.990034882 podStartE2EDuration="1.990034882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:09:02.98864685 +0000 UTC m=+2356.013045326" watchObservedRunningTime="2026-07-24 02:09:02.990034882 +0000 UTC m=+2356.014433420"
Jul 24 02:09:03.079073 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:03.079041    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:03.083726 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:03.083702    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:03.824518 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:03.824481    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:09:03.960887 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:03.960854    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:03.961835 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:03.961815    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:04.981936 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:04.981899    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:05.088707 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:05.088672    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:05.183051 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:05.183022    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:05.864764 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:05.864736    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:05.953388 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:05.953360    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:06.056262 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:06.056216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:09.525053 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:09.525026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:16.107645 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:16.107612    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:09:18.962548 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:18.962508    2568 patch_prober.go:28] interesting pod/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 02:09:18.962988 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:18.962585    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 02:09:19.032813 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:19.032780    2568 generic.go:356] "Generic (PLEG): container finished" podID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerID="01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795" exitCode=0
Jul 24 02:09:19.032992 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:19.032846    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" event={"ID":"94f9bfb0-622f-49c0-8912-afe094261c1e","Type":"ContainerDied","Data":"01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"}
Jul 24 02:09:19.033274 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:19.033259    2568 scope.go:117] "RemoveContainer" containerID="01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"
Jul 24 02:09:19.034382 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:19.034352    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:09:19.034452 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:19.034435    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:09:19.034496 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:19.034467    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:09:20.054605 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:20.054550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" event={"ID":"94f9bfb0-622f-49c0-8912-afe094261c1e","Type":"ContainerStarted","Data":"4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941"}
Jul 24 02:09:20.078991 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:20.078960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:20.079234 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:20.079206    2568 patch_prober.go:28] interesting pod/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 02:09:20.079298 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:20.079269    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 02:09:21.079524 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:21.079492    2568 patch_prober.go:28] interesting pod/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 02:09:21.079950 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:21.079554    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 02:09:22.079142 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:22.079103    2568 patch_prober.go:28] interesting pod/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 02:09:22.079352 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:22.079204    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 02:09:23.080048 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.080013    2568 patch_prober.go:28] interesting pod/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 02:09:23.080480 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.080064    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 02:09:23.699291 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.699259    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"]
Jul 24 02:09:23.699706 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.699693    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="61c341e2-a3e1-429b-a8b7-aa68fa5ed0ad" containerName="istio-proxy"
Jul 24 02:09:23.701634 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.701618    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.705020 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.704995    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"kube-root-ca.crt\""
Jul 24 02:09:23.705159 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.705032    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"default-dockercfg-mkp58\""
Jul 24 02:09:23.705159 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.704995    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"openshift-service-ca.crt\""
Jul 24 02:09:23.705159 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.705112    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"auth-test-model-6bcabd-kserve-self-signed-certs\""
Jul 24 02:09:23.714257 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.714236    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"]
Jul 24 02:09:23.796805 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.796768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:23.809168 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.809136    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-tmp-dir\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.809307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.809173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-dshm\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.809307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.809264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-model-cache\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.809307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.809297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721b8551-a349-429e-a04a-cc4fc9b7ec31-tls-certs\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.809436 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.809328    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-home\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.809436 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.809344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8qm\" (UniqueName: \"kubernetes.io/projected/721b8551-a349-429e-a04a-cc4fc9b7ec31-kube-api-access-hc8qm\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.910791 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.910703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-tmp-dir\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.910987 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.910817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-dshm\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.910987 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.910920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-model-cache\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.910987 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.910955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721b8551-a349-429e-a04a-cc4fc9b7ec31-tls-certs\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.911166 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.910995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-home\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.911166 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.911018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8qm\" (UniqueName: \"kubernetes.io/projected/721b8551-a349-429e-a04a-cc4fc9b7ec31-kube-api-access-hc8qm\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.911315 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.911201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-tmp-dir\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.911315 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.911269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-model-cache\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.911416 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.911379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-home\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.913754 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.913710    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-dshm\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.915148 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.915123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721b8551-a349-429e-a04a-cc4fc9b7ec31-tls-certs\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:23.918997 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:23.918971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8qm\" (UniqueName: \"kubernetes.io/projected/721b8551-a349-429e-a04a-cc4fc9b7ec31-kube-api-access-hc8qm\") pod \"auth-test-model-6bcabd-kserve-5749647ff5-tgtl2\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") " pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:24.022821 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:24.022740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:24.085213 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:24.085113    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:24.086237 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:24.086029    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:24.087083 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:24.087057    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:09:24.160052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:24.159999    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"]
Jul 24 02:09:24.163573 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:09:24.163545    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod721b8551_a349_429e_a04a_cc4fc9b7ec31.slice/crio-2fe1c1edb206dfa35e9e475003b114908de18eb2288d62aff47e7c0efc5d8149 WatchSource:0}: Error finding container 2fe1c1edb206dfa35e9e475003b114908de18eb2288d62aff47e7c0efc5d8149: Status 404 returned error can't find the container with id 2fe1c1edb206dfa35e9e475003b114908de18eb2288d62aff47e7c0efc5d8149
Jul 24 02:09:25.081470 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:25.081433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2" event={"ID":"721b8551-a349-429e-a04a-cc4fc9b7ec31","Type":"ContainerStarted","Data":"d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689"}
Jul 24 02:09:25.081689 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:25.081479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2" event={"ID":"721b8551-a349-429e-a04a-cc4fc9b7ec31","Type":"ContainerStarted","Data":"2fe1c1edb206dfa35e9e475003b114908de18eb2288d62aff47e7c0efc5d8149"}
Jul 24 02:09:25.100980 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:25.100929    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2" podStartSLOduration=2.100911171 podStartE2EDuration="2.100911171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:09:25.099465048 +0000 UTC m=+2378.123863550" watchObservedRunningTime="2026-07-24 02:09:25.100911171 +0000 UTC m=+2378.125309650"
Jul 24 02:09:28.760488 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:28.760447    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:09:34.023544 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:34.023505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:34.024030 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:34.023565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:34.039676 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:34.039647    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:34.135768 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:34.135737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:09:59.165142 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.165108    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"]
Jul 24 02:09:59.168699 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.168677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.171322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.171298    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"auth-test-model-a7fbc1-kserve-self-signed-certs\""
Jul 24 02:09:59.171322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.171316    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"openshift-service-ca.crt\""
Jul 24 02:09:59.172312 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.172288    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"default-dockercfg-5d6km\""
Jul 24 02:09:59.172446 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.172349    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"kube-root-ca.crt\""
Jul 24 02:09:59.181920 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.181895    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"]
Jul 24 02:09:59.201848 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.201818    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:09:59.263354 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.263321    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0c4af0-ae55-47ed-b76e-86a928272059-tls-certs\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.263354 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.263358    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-model-cache\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.263576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.263378    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5486m\" (UniqueName: \"kubernetes.io/projected/4b0c4af0-ae55-47ed-b76e-86a928272059-kube-api-access-5486m\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.263576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.263396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-dshm\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.263576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.263484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-home\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.263576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.263525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-tmp-dir\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.364548 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0c4af0-ae55-47ed-b76e-86a928272059-tls-certs\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.364758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-model-cache\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.364758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5486m\" (UniqueName: \"kubernetes.io/projected/4b0c4af0-ae55-47ed-b76e-86a928272059-kube-api-access-5486m\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.364758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-dshm\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.364758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-home\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.364758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-tmp-dir\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.365021 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.364972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-model-cache\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.365131 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.365112    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-tmp-dir\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.365213 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.365165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-home\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.366888 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.366869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-dshm\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.367127 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.367111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0c4af0-ae55-47ed-b76e-86a928272059-tls-certs\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.373144 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.373122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5486m\" (UniqueName: \"kubernetes.io/projected/4b0c4af0-ae55-47ed-b76e-86a928272059-kube-api-access-5486m\") pod \"auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") " pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.478487 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.478445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:09:59.620071 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:09:59.620006    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"]
Jul 24 02:09:59.622446 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:09:59.622422    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b0c4af0_ae55_47ed_b76e_86a928272059.slice/crio-44c9fd9b6c5f73c4303484b04971789cbcc1f6a9fd65b96f7dca8fc62a82769b WatchSource:0}: Error finding container 44c9fd9b6c5f73c4303484b04971789cbcc1f6a9fd65b96f7dca8fc62a82769b: Status 404 returned error can't find the container with id 44c9fd9b6c5f73c4303484b04971789cbcc1f6a9fd65b96f7dca8fc62a82769b
Jul 24 02:10:00.252301 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:00.252264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6" event={"ID":"4b0c4af0-ae55-47ed-b76e-86a928272059","Type":"ContainerStarted","Data":"3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798"}
Jul 24 02:10:00.252738 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:00.252312    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6" event={"ID":"4b0c4af0-ae55-47ed-b76e-86a928272059","Type":"ContainerStarted","Data":"44c9fd9b6c5f73c4303484b04971789cbcc1f6a9fd65b96f7dca8fc62a82769b"}
Jul 24 02:10:00.273839 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:00.273786    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6" podStartSLOduration=1.273770235 podStartE2EDuration="1.273770235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:10:00.271978456 +0000 UTC m=+2413.296376935" watchObservedRunningTime="2026-07-24 02:10:00.273770235 +0000 UTC m=+2413.298168711"
Jul 24 02:10:02.795970 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:02.795925    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:10:09.479316 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:09.479210    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:10:09.479316 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:09.479269    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:10:09.491639 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:09.491609    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:10:10.313718 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:10.313688    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:10:37.494404 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:37.494371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:10:52.561134 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:52.561100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:10:54.797828 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:10:54.794538    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:11:15.909192 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:11:15.909141    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:11:32.991498 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:11:32.991455    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:11:42.173197 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:11:42.173081    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:11:52.699720 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:11:52.699687    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:11:53.500154 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:11:53.500112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:11:53.598524 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:11:53.598470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:12:10.113034 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:10.112995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:12:11.583092 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:11.583053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:12:26.496063 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:26.496017    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:12:31.062052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:31.062014    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"]
Jul 24 02:12:31.082035 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:31.081970    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:12:32.061610 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:32.061566    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"]
Jul 24 02:12:32.090259 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:32.090196    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:12:34.868430 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:34.868383    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:12:43.188472 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:43.188428    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:12:46.081032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.080990    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2" podUID="721b8551-a349-429e-a04a-cc4fc9b7ec31" containerName="main" containerID="cri-o://d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689" gracePeriod=45
Jul 24 02:12:46.336626 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.336564    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:12:46.499644 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499609    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-model-cache\") pod \"721b8551-a349-429e-a04a-cc4fc9b7ec31\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") "
Jul 24 02:12:46.499825 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499654    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-home\") pod \"721b8551-a349-429e-a04a-cc4fc9b7ec31\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") "
Jul 24 02:12:46.499825 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499731    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-tmp-dir\") pod \"721b8551-a349-429e-a04a-cc4fc9b7ec31\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") "
Jul 24 02:12:46.499825 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499753    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721b8551-a349-429e-a04a-cc4fc9b7ec31-tls-certs\") pod \"721b8551-a349-429e-a04a-cc4fc9b7ec31\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") "
Jul 24 02:12:46.499825 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499777    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-dshm\") pod \"721b8551-a349-429e-a04a-cc4fc9b7ec31\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") "
Jul 24 02:12:46.499825 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499826    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc8qm\" (UniqueName: \"kubernetes.io/projected/721b8551-a349-429e-a04a-cc4fc9b7ec31-kube-api-access-hc8qm\") pod \"721b8551-a349-429e-a04a-cc4fc9b7ec31\" (UID: \"721b8551-a349-429e-a04a-cc4fc9b7ec31\") "
Jul 24 02:12:46.500104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499934    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-model-cache" (OuterVolumeSpecName: "model-cache") pod "721b8551-a349-429e-a04a-cc4fc9b7ec31" (UID: "721b8551-a349-429e-a04a-cc4fc9b7ec31"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:46.500104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499983    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "721b8551-a349-429e-a04a-cc4fc9b7ec31" (UID: "721b8551-a349-429e-a04a-cc4fc9b7ec31"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:46.500104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.499997    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-home" (OuterVolumeSpecName: "home") pod "721b8551-a349-429e-a04a-cc4fc9b7ec31" (UID: "721b8551-a349-429e-a04a-cc4fc9b7ec31"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:46.500267 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.500125    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:46.500267 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.500145    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:46.500267 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.500209    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:46.502098 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.502073    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721b8551-a349-429e-a04a-cc4fc9b7ec31-kube-api-access-hc8qm" (OuterVolumeSpecName: "kube-api-access-hc8qm") pod "721b8551-a349-429e-a04a-cc4fc9b7ec31" (UID: "721b8551-a349-429e-a04a-cc4fc9b7ec31"). InnerVolumeSpecName "kube-api-access-hc8qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:12:46.502098 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.502082    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721b8551-a349-429e-a04a-cc4fc9b7ec31-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "721b8551-a349-429e-a04a-cc4fc9b7ec31" (UID: "721b8551-a349-429e-a04a-cc4fc9b7ec31"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:12:46.502232 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.502130    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-dshm" (OuterVolumeSpecName: "dshm") pod "721b8551-a349-429e-a04a-cc4fc9b7ec31" (UID: "721b8551-a349-429e-a04a-cc4fc9b7ec31"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:46.601721 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.601638    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc8qm\" (UniqueName: \"kubernetes.io/projected/721b8551-a349-429e-a04a-cc4fc9b7ec31-kube-api-access-hc8qm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:46.601721 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.601673    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721b8551-a349-429e-a04a-cc4fc9b7ec31-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:46.601721 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:46.601684    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/721b8551-a349-429e-a04a-cc4fc9b7ec31-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:47.060577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.060542    2568 generic.go:356] "Generic (PLEG): container finished" podID="721b8551-a349-429e-a04a-cc4fc9b7ec31" containerID="d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689" exitCode=0
Jul 24 02:12:47.060785 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.060597    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"
Jul 24 02:12:47.060785 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.060636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2" event={"ID":"721b8551-a349-429e-a04a-cc4fc9b7ec31","Type":"ContainerDied","Data":"d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689"}
Jul 24 02:12:47.060785 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.060685    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2" event={"ID":"721b8551-a349-429e-a04a-cc4fc9b7ec31","Type":"ContainerDied","Data":"2fe1c1edb206dfa35e9e475003b114908de18eb2288d62aff47e7c0efc5d8149"}
Jul 24 02:12:47.060785 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.060708    2568 scope.go:117] "RemoveContainer" containerID="d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689"
Jul 24 02:12:47.070259 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.070247    2568 scope.go:117] "RemoveContainer" containerID="d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689"
Jul 24 02:12:47.070498 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:12:47.070477    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689\": container with ID starting with d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689 not found: ID does not exist" containerID="d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689"
Jul 24 02:12:47.070571 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.070510    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689"} err="failed to get container status \"d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689\": rpc error: code = NotFound desc = could not find container \"d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689\": container with ID starting with d0bf68629ba26432f7416d69079edd35fc6a983b75b43b4d8439887421ce6689 not found: ID does not exist"
Jul 24 02:12:47.080700 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.080669    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6" podUID="4b0c4af0-ae55-47ed-b76e-86a928272059" containerName="main" containerID="cri-o://3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798" gracePeriod=45
Jul 24 02:12:47.081810 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.081787    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"]
Jul 24 02:12:47.085459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.085438    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/auth-test-model-6bcabd-kserve-5749647ff5-tgtl2"]
Jul 24 02:12:47.345224 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.345189    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:12:47.504892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.504861    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="721b8551-a349-429e-a04a-cc4fc9b7ec31" path="/var/lib/kubelet/pods/721b8551-a349-429e-a04a-cc4fc9b7ec31/volumes"
Jul 24 02:12:47.511805 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.511781    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5486m\" (UniqueName: \"kubernetes.io/projected/4b0c4af0-ae55-47ed-b76e-86a928272059-kube-api-access-5486m\") pod \"4b0c4af0-ae55-47ed-b76e-86a928272059\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") "
Jul 24 02:12:47.511937 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.511816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-dshm\") pod \"4b0c4af0-ae55-47ed-b76e-86a928272059\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") "
Jul 24 02:12:47.511937 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.511840    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-tmp-dir\") pod \"4b0c4af0-ae55-47ed-b76e-86a928272059\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") "
Jul 24 02:12:47.512058 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.511991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-model-cache\") pod \"4b0c4af0-ae55-47ed-b76e-86a928272059\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") "
Jul 24 02:12:47.512058 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512029    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-home\") pod \"4b0c4af0-ae55-47ed-b76e-86a928272059\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") "
Jul 24 02:12:47.512166 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512057    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0c4af0-ae55-47ed-b76e-86a928272059-tls-certs\") pod \"4b0c4af0-ae55-47ed-b76e-86a928272059\" (UID: \"4b0c4af0-ae55-47ed-b76e-86a928272059\") "
Jul 24 02:12:47.512166 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512141    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b0c4af0-ae55-47ed-b76e-86a928272059" (UID: "4b0c4af0-ae55-47ed-b76e-86a928272059"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:47.512314 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512249    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b0c4af0-ae55-47ed-b76e-86a928272059" (UID: "4b0c4af0-ae55-47ed-b76e-86a928272059"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:47.512314 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512276    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-home" (OuterVolumeSpecName: "home") pod "4b0c4af0-ae55-47ed-b76e-86a928272059" (UID: "4b0c4af0-ae55-47ed-b76e-86a928272059"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:47.512662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512643    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:47.512735 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512667    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:47.512735 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.512680    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:47.513991 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.513965    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-dshm" (OuterVolumeSpecName: "dshm") pod "4b0c4af0-ae55-47ed-b76e-86a928272059" (UID: "4b0c4af0-ae55-47ed-b76e-86a928272059"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:12:47.514209 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.514190    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0c4af0-ae55-47ed-b76e-86a928272059-kube-api-access-5486m" (OuterVolumeSpecName: "kube-api-access-5486m") pod "4b0c4af0-ae55-47ed-b76e-86a928272059" (UID: "4b0c4af0-ae55-47ed-b76e-86a928272059"). InnerVolumeSpecName "kube-api-access-5486m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:12:47.514290 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.514235    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b0c4af0-ae55-47ed-b76e-86a928272059-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b0c4af0-ae55-47ed-b76e-86a928272059" (UID: "4b0c4af0-ae55-47ed-b76e-86a928272059"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:12:47.614115 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.614027    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5486m\" (UniqueName: \"kubernetes.io/projected/4b0c4af0-ae55-47ed-b76e-86a928272059-kube-api-access-5486m\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:47.614115 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.614061    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b0c4af0-ae55-47ed-b76e-86a928272059-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:47.614115 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:47.614072    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b0c4af0-ae55-47ed-b76e-86a928272059-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:12:48.066341 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.066299    2568 generic.go:356] "Generic (PLEG): container finished" podID="4b0c4af0-ae55-47ed-b76e-86a928272059" containerID="3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798" exitCode=0
Jul 24 02:12:48.066341 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.066347    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"
Jul 24 02:12:48.066577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.066385    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6" event={"ID":"4b0c4af0-ae55-47ed-b76e-86a928272059","Type":"ContainerDied","Data":"3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798"}
Jul 24 02:12:48.066577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.066430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6" event={"ID":"4b0c4af0-ae55-47ed-b76e-86a928272059","Type":"ContainerDied","Data":"44c9fd9b6c5f73c4303484b04971789cbcc1f6a9fd65b96f7dca8fc62a82769b"}
Jul 24 02:12:48.066577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.066450    2568 scope.go:117] "RemoveContainer" containerID="3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798"
Jul 24 02:12:48.074923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.074907    2568 scope.go:117] "RemoveContainer" containerID="3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798"
Jul 24 02:12:48.075163 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:12:48.075141    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798\": container with ID starting with 3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798 not found: ID does not exist" containerID="3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798"
Jul 24 02:12:48.075275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.075168    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798"} err="failed to get container status \"3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798\": rpc error: code = NotFound desc = could not find container \"3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798\": container with ID starting with 3f2614a5b4919304218a6fad367b22c2d041559b84b3fbbfed06ab3dd67b1798 not found: ID does not exist"
Jul 24 02:12:48.087107 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.087084    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"]
Jul 24 02:12:48.091764 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:48.091743    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/auth-test-model-a7fbc1-kserve-6958498fc9-q8qs6"]
Jul 24 02:12:49.505451 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:49.505415    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b0c4af0-ae55-47ed-b76e-86a928272059" path="/var/lib/kubelet/pods/4b0c4af0-ae55-47ed-b76e-86a928272059/volumes"
Jul 24 02:12:56.274027 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.273990    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"]
Jul 24 02:12:56.274649 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.274619    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721b8551-a349-429e-a04a-cc4fc9b7ec31" containerName="main"
Jul 24 02:12:56.274649 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.274647    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="721b8551-a349-429e-a04a-cc4fc9b7ec31" containerName="main"
Jul 24 02:12:56.274808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.274662    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0c4af0-ae55-47ed-b76e-86a928272059" containerName="main"
Jul 24 02:12:56.274808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.274671    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0c4af0-ae55-47ed-b76e-86a928272059" containerName="main"
Jul 24 02:12:56.274808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.274770    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0c4af0-ae55-47ed-b76e-86a928272059" containerName="main"
Jul 24 02:12:56.274808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.274785    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="721b8551-a349-429e-a04a-cc4fc9b7ec31" containerName="main"
Jul 24 02:12:56.277983 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.277963    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.280496 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.280473    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"default-dockercfg-5d6km\""
Jul 24 02:12:56.280610 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.280473    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"openshift-service-ca.crt\""
Jul 24 02:12:56.281419 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.281402    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"sub-test-model-a7fbc1-kserve-self-signed-certs\""
Jul 24 02:12:56.281525 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.281461    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"kube-root-ca.crt\""
Jul 24 02:12:56.285502 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.285478    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"]
Jul 24 02:12:56.304694 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.304664    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:12:56.398293 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.398260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzk9t\" (UniqueName: \"kubernetes.io/projected/4a0cc819-ef4a-4723-88fb-f287bc442f71-kube-api-access-tzk9t\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.398454 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.398300    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-tmp-dir\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.398454 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.398414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a0cc819-ef4a-4723-88fb-f287bc442f71-tls-certs\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.398577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.398479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-model-cache\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.398577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.398535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-home\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.398577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.398563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-dshm\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499151 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499117    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a0cc819-ef4a-4723-88fb-f287bc442f71-tls-certs\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499403 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-model-cache\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499403 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-home\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499403 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-dshm\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499568 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzk9t\" (UniqueName: \"kubernetes.io/projected/4a0cc819-ef4a-4723-88fb-f287bc442f71-kube-api-access-tzk9t\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499568 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-tmp-dir\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499680 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499649    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-home\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499680 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-model-cache\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.499770 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.499754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-tmp-dir\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.501572 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.501549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-dshm\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.501742 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.501724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a0cc819-ef4a-4723-88fb-f287bc442f71-tls-certs\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.507133 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.507112    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzk9t\" (UniqueName: \"kubernetes.io/projected/4a0cc819-ef4a-4723-88fb-f287bc442f71-kube-api-access-tzk9t\") pod \"sub-test-model-a7fbc1-kserve-689c855-ndfg7\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") " pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.598940 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.598852    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:12:56.735342 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:56.735316    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"]
Jul 24 02:12:56.737617 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:12:56.737591    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a0cc819_ef4a_4723_88fb_f287bc442f71.slice/crio-8dc9554aa8df63b88f06139d74829ac6d792fa3eaff0de83057139bf0eaf6322 WatchSource:0}: Error finding container 8dc9554aa8df63b88f06139d74829ac6d792fa3eaff0de83057139bf0eaf6322: Status 404 returned error can't find the container with id 8dc9554aa8df63b88f06139d74829ac6d792fa3eaff0de83057139bf0eaf6322
Jul 24 02:12:57.112392 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:57.112353    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7" event={"ID":"4a0cc819-ef4a-4723-88fb-f287bc442f71","Type":"ContainerStarted","Data":"5cccbd835aa4a73a8c48d202e1f57ed516fae0c0bbaf0b6455c4ab10b2acd3a7"}
Jul 24 02:12:57.112392 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:57.112396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7" event={"ID":"4a0cc819-ef4a-4723-88fb-f287bc442f71","Type":"ContainerStarted","Data":"8dc9554aa8df63b88f06139d74829ac6d792fa3eaff0de83057139bf0eaf6322"}
Jul 24 02:12:57.129323 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:57.129278    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7" podStartSLOduration=1.129263908 podStartE2EDuration="1.129263908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:12:57.127252194 +0000 UTC m=+2590.151650672" watchObservedRunningTime="2026-07-24 02:12:57.129263908 +0000 UTC m=+2590.153662384"
Jul 24 02:12:59.976869 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:12:59.976826    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:13:06.599552 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:06.599515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:13:06.600018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:06.599573    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:13:06.612484 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:06.612448    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:13:07.174029 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:07.174002    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:13:13.691741 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:13.691708    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:13:32.723804 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:32.723768    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:13:39.369874 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:39.369840    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:13:40.254229 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:40.254170    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"]
Jul 24 02:13:40.296034 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:40.295998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:13:51.686805 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:51.686765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:13:55.273026 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.272956    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7" podUID="4a0cc819-ef4a-4723-88fb-f287bc442f71" containerName="main" containerID="cri-o://5cccbd835aa4a73a8c48d202e1f57ed516fae0c0bbaf0b6455c4ab10b2acd3a7" gracePeriod=45
Jul 24 02:13:55.404467 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.404434    2568 generic.go:356] "Generic (PLEG): container finished" podID="4a0cc819-ef4a-4723-88fb-f287bc442f71" containerID="5cccbd835aa4a73a8c48d202e1f57ed516fae0c0bbaf0b6455c4ab10b2acd3a7" exitCode=0
Jul 24 02:13:55.404627 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.404508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7" event={"ID":"4a0cc819-ef4a-4723-88fb-f287bc442f71","Type":"ContainerDied","Data":"5cccbd835aa4a73a8c48d202e1f57ed516fae0c0bbaf0b6455c4ab10b2acd3a7"}
Jul 24 02:13:55.520871 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.520844    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:13:55.673916 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.673836    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-home\") pod \"4a0cc819-ef4a-4723-88fb-f287bc442f71\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") "
Jul 24 02:13:55.674052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.673933    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzk9t\" (UniqueName: \"kubernetes.io/projected/4a0cc819-ef4a-4723-88fb-f287bc442f71-kube-api-access-tzk9t\") pod \"4a0cc819-ef4a-4723-88fb-f287bc442f71\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") "
Jul 24 02:13:55.674052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.673956    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a0cc819-ef4a-4723-88fb-f287bc442f71-tls-certs\") pod \"4a0cc819-ef4a-4723-88fb-f287bc442f71\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") "
Jul 24 02:13:55.674052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.673975    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-model-cache\") pod \"4a0cc819-ef4a-4723-88fb-f287bc442f71\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") "
Jul 24 02:13:55.674052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.673996    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-tmp-dir\") pod \"4a0cc819-ef4a-4723-88fb-f287bc442f71\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") "
Jul 24 02:13:55.674052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.674041    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-dshm\") pod \"4a0cc819-ef4a-4723-88fb-f287bc442f71\" (UID: \"4a0cc819-ef4a-4723-88fb-f287bc442f71\") "
Jul 24 02:13:55.674296 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.674112    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-home" (OuterVolumeSpecName: "home") pod "4a0cc819-ef4a-4723-88fb-f287bc442f71" (UID: "4a0cc819-ef4a-4723-88fb-f287bc442f71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:13:55.674296 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.674201    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a0cc819-ef4a-4723-88fb-f287bc442f71" (UID: "4a0cc819-ef4a-4723-88fb-f287bc442f71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:13:55.674296 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.674272    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a0cc819-ef4a-4723-88fb-f287bc442f71" (UID: "4a0cc819-ef4a-4723-88fb-f287bc442f71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:13:55.674456 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.674336    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:13:55.674456 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.674349    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:13:55.676145 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.676110    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a0cc819-ef4a-4723-88fb-f287bc442f71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a0cc819-ef4a-4723-88fb-f287bc442f71" (UID: "4a0cc819-ef4a-4723-88fb-f287bc442f71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:13:55.676145 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.676127    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a0cc819-ef4a-4723-88fb-f287bc442f71-kube-api-access-tzk9t" (OuterVolumeSpecName: "kube-api-access-tzk9t") pod "4a0cc819-ef4a-4723-88fb-f287bc442f71" (UID: "4a0cc819-ef4a-4723-88fb-f287bc442f71"). InnerVolumeSpecName "kube-api-access-tzk9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:13:55.676322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.676157    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-dshm" (OuterVolumeSpecName: "dshm") pod "4a0cc819-ef4a-4723-88fb-f287bc442f71" (UID: "4a0cc819-ef4a-4723-88fb-f287bc442f71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:13:55.774946 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.774920    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzk9t\" (UniqueName: \"kubernetes.io/projected/4a0cc819-ef4a-4723-88fb-f287bc442f71-kube-api-access-tzk9t\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:13:55.774946 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.774944    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a0cc819-ef4a-4723-88fb-f287bc442f71-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:13:55.774946 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.774954    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:13:55.775190 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:55.774962    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a0cc819-ef4a-4723-88fb-f287bc442f71-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:13:56.409989 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.409957    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"
Jul 24 02:13:56.410478 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.409954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7" event={"ID":"4a0cc819-ef4a-4723-88fb-f287bc442f71","Type":"ContainerDied","Data":"8dc9554aa8df63b88f06139d74829ac6d792fa3eaff0de83057139bf0eaf6322"}
Jul 24 02:13:56.410478 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.410090    2568 scope.go:117] "RemoveContainer" containerID="5cccbd835aa4a73a8c48d202e1f57ed516fae0c0bbaf0b6455c4ab10b2acd3a7"
Jul 24 02:13:56.430129 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.430103    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"]
Jul 24 02:13:56.434294 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.434267    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/sub-test-model-a7fbc1-kserve-689c855-ndfg7"]
Jul 24 02:13:56.871676 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.871642    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"]
Jul 24 02:13:56.872044 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.872031    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a0cc819-ef4a-4723-88fb-f287bc442f71" containerName="main"
Jul 24 02:13:56.872090 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.872046    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a0cc819-ef4a-4723-88fb-f287bc442f71" containerName="main"
Jul 24 02:13:56.872138 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.872129    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a0cc819-ef4a-4723-88fb-f287bc442f71" containerName="main"
Jul 24 02:13:56.876710 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.876692    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:56.879858 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.879834    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"default-dockercfg-mkp58\""
Jul 24 02:13:56.880009 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.879884    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"kube-root-ca.crt\""
Jul 24 02:13:56.880009 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.879909    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"rate-test-model-6bcabd-kserve-self-signed-certs\""
Jul 24 02:13:56.880009 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.879942    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6bcabd\"/\"openshift-service-ca.crt\""
Jul 24 02:13:56.883983 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.883960    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"]
Jul 24 02:13:56.904172 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.904145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:13:56.986905 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.986870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-dshm\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:56.987066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.986976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-tmp-dir\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:56.987066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.987005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2htc\" (UniqueName: \"kubernetes.io/projected/3531013e-7d10-4df4-8ea3-40815074c15a-kube-api-access-k2htc\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:56.987066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.987029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-model-cache\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:56.987066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.987064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-home\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:56.987275 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:56.987098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3531013e-7d10-4df4-8ea3-40815074c15a-tls-certs\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088117 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-dshm\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088386 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-tmp-dir\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088386 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2htc\" (UniqueName: \"kubernetes.io/projected/3531013e-7d10-4df4-8ea3-40815074c15a-kube-api-access-k2htc\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088386 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-model-cache\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088386 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-home\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088613 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3531013e-7d10-4df4-8ea3-40815074c15a-tls-certs\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088679 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-tmp-dir\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.088907 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-model-cache\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.089019 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.088906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-home\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.090432 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.090415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-dshm\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.091008 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.090987    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3531013e-7d10-4df4-8ea3-40815074c15a-tls-certs\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.095982 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.095959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2htc\" (UniqueName: \"kubernetes.io/projected/3531013e-7d10-4df4-8ea3-40815074c15a-kube-api-access-k2htc\") pod \"rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") " pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.203119 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.203084    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:13:57.334907 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.334874    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"]
Jul 24 02:13:57.338388 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:13:57.338362    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3531013e_7d10_4df4_8ea3_40815074c15a.slice/crio-126c2dac0c947de2acee5992f974c527c997c90110f531ec824e428a6f9664bc WatchSource:0}: Error finding container 126c2dac0c947de2acee5992f974c527c997c90110f531ec824e428a6f9664bc: Status 404 returned error can't find the container with id 126c2dac0c947de2acee5992f974c527c997c90110f531ec824e428a6f9664bc
Jul 24 02:13:57.420354 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.420321    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr" event={"ID":"3531013e-7d10-4df4-8ea3-40815074c15a","Type":"ContainerStarted","Data":"ce8abf7fa6057d05738bb75cd334ac8f5d499e8eb6da628c21adc010912dc185"}
Jul 24 02:13:57.420747 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.420368    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr" event={"ID":"3531013e-7d10-4df4-8ea3-40815074c15a","Type":"ContainerStarted","Data":"126c2dac0c947de2acee5992f974c527c997c90110f531ec824e428a6f9664bc"}
Jul 24 02:13:57.437431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.437387    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr" podStartSLOduration=1.437370284 podStartE2EDuration="1.437370284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:13:57.436435693 +0000 UTC m=+2650.460834194" watchObservedRunningTime="2026-07-24 02:13:57.437370284 +0000 UTC m=+2650.461768761"
Jul 24 02:13:57.504979 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:13:57.504900    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a0cc819-ef4a-4723-88fb-f287bc442f71" path="/var/lib/kubelet/pods/4a0cc819-ef4a-4723-88fb-f287bc442f71/volumes"
Jul 24 02:14:02.197034 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:02.196997    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:14:07.203646 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:07.203607    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:14:07.204150 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:07.203665    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:14:07.216611 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:07.216587    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:14:07.481509 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:07.481423    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:14:08.611643 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:08.611610    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:14:08.711539 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:08.711499    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:14:21.374013 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.373975    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"]
Jul 24 02:14:21.378046 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.378026    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.381225 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.381150    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"kube-root-ca.crt\""
Jul 24 02:14:21.381341 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.381153    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"rate-test-model-a7fbc1-kserve-self-signed-certs\""
Jul 24 02:14:21.381341 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.381157    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"openshift-service-ca.crt\""
Jul 24 02:14:21.381459 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.381289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a7fbc1\"/\"default-dockercfg-5d6km\""
Jul 24 02:14:21.385109 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.385061    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"]
Jul 24 02:14:21.408055 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.408030    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:14:21.428374 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.428350    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tmp-dir\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.428534 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.428402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-home\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.428534 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.428446    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jldhb\" (UniqueName: \"kubernetes.io/projected/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-kube-api-access-jldhb\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.428534 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.428474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tls-certs\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.428534 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.428522    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-dshm\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.428752 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.428581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-model-cache\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529471 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tmp-dir\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-home\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jldhb\" (UniqueName: \"kubernetes.io/projected/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-kube-api-access-jldhb\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tls-certs\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-dshm\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529891 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-model-cache\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529948 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529897    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tmp-dir\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.529948 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.529929    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-home\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.530099 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.530081    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-model-cache\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.531901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.531882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-dshm\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.532408 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.532387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tls-certs\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.537057 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.537033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jldhb\" (UniqueName: \"kubernetes.io/projected/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-kube-api-access-jldhb\") pod \"rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") " pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.689380 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.689340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:21.825808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:21.825783    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"]
Jul 24 02:14:21.827927 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:14:21.827893    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ca553c7_27ff_4adb_b6e4_d2df9e5bb382.slice/crio-2d5a72ad1d4cd897ce36e00790383894ca48b03b16e60454ed709f27a747e85d WatchSource:0}: Error finding container 2d5a72ad1d4cd897ce36e00790383894ca48b03b16e60454ed709f27a747e85d: Status 404 returned error can't find the container with id 2d5a72ad1d4cd897ce36e00790383894ca48b03b16e60454ed709f27a747e85d
Jul 24 02:14:22.545201 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:22.545143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc" event={"ID":"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382","Type":"ContainerStarted","Data":"318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928"}
Jul 24 02:14:22.545676 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:22.545214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc" event={"ID":"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382","Type":"ContainerStarted","Data":"2d5a72ad1d4cd897ce36e00790383894ca48b03b16e60454ed709f27a747e85d"}
Jul 24 02:14:22.562739 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:22.562689    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc" podStartSLOduration=1.562675296 podStartE2EDuration="1.562675296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:14:22.561492942 +0000 UTC m=+2675.585891419" watchObservedRunningTime="2026-07-24 02:14:22.562675296 +0000 UTC m=+2675.587073774"
Jul 24 02:14:24.981816 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:24.981778    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:14:31.075113 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:31.075077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:14:31.175298 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:31.175264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:14:31.690044 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:31.690010    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:31.690301 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:31.690067    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:31.702549 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:31.702524    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:32.605314 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:32.605285    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:14:44.494590 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:44.494550    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:14:59.090946 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:14:59.090910    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:15:05.655863 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:05.655825    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"]
Jul 24 02:15:05.696755 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:05.696707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:06.573052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:06.573017    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"]
Jul 24 02:15:06.592415 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:06.592380    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:07.580099 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.580061    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-140117713222576"]
Jul 24 02:15:07.583576 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.583560    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:07.585859 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.585837    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q8hnt\""
Jul 24 02:15:07.590283 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.590262    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713222576"]
Jul 24 02:15:07.692195 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.692142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ccr\" (UniqueName: \"kubernetes.io/projected/f43c6dd0-214b-476f-bf7c-3a421e4e42cd-kube-api-access-z5ccr\") pod \"test-curl-7797-140117713222576\" (UID: \"f43c6dd0-214b-476f-bf7c-3a421e4e42cd\") " pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:07.792856 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.792824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ccr\" (UniqueName: \"kubernetes.io/projected/f43c6dd0-214b-476f-bf7c-3a421e4e42cd-kube-api-access-z5ccr\") pod \"test-curl-7797-140117713222576\" (UID: \"f43c6dd0-214b-476f-bf7c-3a421e4e42cd\") " pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:07.800664 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.800635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ccr\" (UniqueName: \"kubernetes.io/projected/f43c6dd0-214b-476f-bf7c-3a421e4e42cd-kube-api-access-z5ccr\") pod \"test-curl-7797-140117713222576\" (UID: \"f43c6dd0-214b-476f-bf7c-3a421e4e42cd\") " pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:07.894430 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:07.894334    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:08.031159 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:08.031134    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713222576"]
Jul 24 02:15:08.033693 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:08.033662    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf43c6dd0_214b_476f_bf7c_3a421e4e42cd.slice/crio-be01147046925b3c33a299f146e8199741046ea041ba3326ae7a0a1fe27edd18 WatchSource:0}: Error finding container be01147046925b3c33a299f146e8199741046ea041ba3326ae7a0a1fe27edd18: Status 404 returned error can't find the container with id be01147046925b3c33a299f146e8199741046ea041ba3326ae7a0a1fe27edd18
Jul 24 02:15:08.035104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:08.035082    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 02:15:08.774856 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:08.774824    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713222576" event={"ID":"f43c6dd0-214b-476f-bf7c-3a421e4e42cd","Type":"ContainerStarted","Data":"be01147046925b3c33a299f146e8199741046ea041ba3326ae7a0a1fe27edd18"}
Jul 24 02:15:09.781454 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:09.781421    2568 generic.go:356] "Generic (PLEG): container finished" podID="f43c6dd0-214b-476f-bf7c-3a421e4e42cd" containerID="33cc8df6778605f14e999b73fcd923c2974d7863c9d23472ee57391bf171f079" exitCode=0
Jul 24 02:15:09.781875 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:09.781519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713222576" event={"ID":"f43c6dd0-214b-476f-bf7c-3a421e4e42cd","Type":"ContainerDied","Data":"33cc8df6778605f14e999b73fcd923c2974d7863c9d23472ee57391bf171f079"}
Jul 24 02:15:10.927196 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:10.927150    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:10.951598 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:10.951572    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7797-140117713222576_f43c6dd0-214b-476f-bf7c-3a421e4e42cd/test-curl-7797-140117713222576/0.log"
Jul 24 02:15:10.979100 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:10.979066    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-140117713222576"]
Jul 24 02:15:10.983822 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:10.983797    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-140117713222576"]
Jul 24 02:15:11.024781 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.024756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5ccr\" (UniqueName: \"kubernetes.io/projected/f43c6dd0-214b-476f-bf7c-3a421e4e42cd-kube-api-access-z5ccr\") pod \"f43c6dd0-214b-476f-bf7c-3a421e4e42cd\" (UID: \"f43c6dd0-214b-476f-bf7c-3a421e4e42cd\") "
Jul 24 02:15:11.027017 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.026984    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f43c6dd0-214b-476f-bf7c-3a421e4e42cd-kube-api-access-z5ccr" (OuterVolumeSpecName: "kube-api-access-z5ccr") pod "f43c6dd0-214b-476f-bf7c-3a421e4e42cd" (UID: "f43c6dd0-214b-476f-bf7c-3a421e4e42cd"). InnerVolumeSpecName "kube-api-access-z5ccr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:11.112297 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.112208    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-140117713223088"]
Jul 24 02:15:11.112712 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.112693    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f43c6dd0-214b-476f-bf7c-3a421e4e42cd" containerName="test-curl-7797-140117713222576"
Jul 24 02:15:11.112805 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.112716    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f43c6dd0-214b-476f-bf7c-3a421e4e42cd" containerName="test-curl-7797-140117713222576"
Jul 24 02:15:11.112865 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.112810    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f43c6dd0-214b-476f-bf7c-3a421e4e42cd" containerName="test-curl-7797-140117713222576"
Jul 24 02:15:11.115752 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.115733    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:11.121816 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.121790    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713223088"]
Jul 24 02:15:11.125554 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.125530    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5ccr\" (UniqueName: \"kubernetes.io/projected/f43c6dd0-214b-476f-bf7c-3a421e4e42cd-kube-api-access-z5ccr\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:11.226530 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.226488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688wx\" (UniqueName: \"kubernetes.io/projected/4d08691a-46d4-47bb-9809-215fe049acd2-kube-api-access-688wx\") pod \"test-curl-7797-140117713223088\" (UID: \"4d08691a-46d4-47bb-9809-215fe049acd2\") " pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:11.327601 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.327569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688wx\" (UniqueName: \"kubernetes.io/projected/4d08691a-46d4-47bb-9809-215fe049acd2-kube-api-access-688wx\") pod \"test-curl-7797-140117713223088\" (UID: \"4d08691a-46d4-47bb-9809-215fe049acd2\") " pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:11.335948 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.335915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-688wx\" (UniqueName: \"kubernetes.io/projected/4d08691a-46d4-47bb-9809-215fe049acd2-kube-api-access-688wx\") pod \"test-curl-7797-140117713223088\" (UID: \"4d08691a-46d4-47bb-9809-215fe049acd2\") " pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:11.426630 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.426545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:11.505826 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.505791    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f43c6dd0-214b-476f-bf7c-3a421e4e42cd" path="/var/lib/kubelet/pods/f43c6dd0-214b-476f-bf7c-3a421e4e42cd/volumes"
Jul 24 02:15:11.562047 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.562024    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713223088"]
Jul 24 02:15:11.564054 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:11.564028    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d08691a_46d4_47bb_9809_215fe049acd2.slice/crio-49997930d463cf16644dd7e71d1886299a47331de8506b582d06ffa51ed78498 WatchSource:0}: Error finding container 49997930d463cf16644dd7e71d1886299a47331de8506b582d06ffa51ed78498: Status 404 returned error can't find the container with id 49997930d463cf16644dd7e71d1886299a47331de8506b582d06ffa51ed78498
Jul 24 02:15:11.792254 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.792224    2568 scope.go:117] "RemoveContainer" containerID="33cc8df6778605f14e999b73fcd923c2974d7863c9d23472ee57391bf171f079"
Jul 24 02:15:11.792441 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.792222    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713222576"
Jul 24 02:15:11.793619 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:11.793471    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713223088" event={"ID":"4d08691a-46d4-47bb-9809-215fe049acd2","Type":"ContainerStarted","Data":"49997930d463cf16644dd7e71d1886299a47331de8506b582d06ffa51ed78498"}
Jul 24 02:15:12.801324 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:12.801288    2568 generic.go:356] "Generic (PLEG): container finished" podID="4d08691a-46d4-47bb-9809-215fe049acd2" containerID="64bfa028e0a0d4ac8496ab50f2ad035caea3c30b29ba3e9aae8a596ec4841840" exitCode=0
Jul 24 02:15:12.801718 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:12.801372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713223088" event={"ID":"4d08691a-46d4-47bb-9809-215fe049acd2","Type":"ContainerDied","Data":"64bfa028e0a0d4ac8496ab50f2ad035caea3c30b29ba3e9aae8a596ec4841840"}
Jul 24 02:15:13.939531 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:13.939501    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:13.958762 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:13.958734    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7797-140117713223088_4d08691a-46d4-47bb-9809-215fe049acd2/test-curl-7797-140117713223088/0.log"
Jul 24 02:15:13.983079 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:13.983046    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-140117713223088"]
Jul 24 02:15:13.986626 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:13.986600    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-140117713223088"]
Jul 24 02:15:14.057989 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.057889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-688wx\" (UniqueName: \"kubernetes.io/projected/4d08691a-46d4-47bb-9809-215fe049acd2-kube-api-access-688wx\") pod \"4d08691a-46d4-47bb-9809-215fe049acd2\" (UID: \"4d08691a-46d4-47bb-9809-215fe049acd2\") "
Jul 24 02:15:14.059983 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.059960    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d08691a-46d4-47bb-9809-215fe049acd2-kube-api-access-688wx" (OuterVolumeSpecName: "kube-api-access-688wx") pod "4d08691a-46d4-47bb-9809-215fe049acd2" (UID: "4d08691a-46d4-47bb-9809-215fe049acd2"). InnerVolumeSpecName "kube-api-access-688wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:14.154042 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.154011    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:14.154443 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.154429    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d08691a-46d4-47bb-9809-215fe049acd2" containerName="test-curl-7797-140117713223088"
Jul 24 02:15:14.154499 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.154444    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d08691a-46d4-47bb-9809-215fe049acd2" containerName="test-curl-7797-140117713223088"
Jul 24 02:15:14.154543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.154512    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d08691a-46d4-47bb-9809-215fe049acd2" containerName="test-curl-7797-140117713223088"
Jul 24 02:15:14.157501 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.157486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:14.159403 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.159383    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-688wx\" (UniqueName: \"kubernetes.io/projected/4d08691a-46d4-47bb-9809-215fe049acd2-kube-api-access-688wx\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:14.163274 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.163253    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:14.259935 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.259900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvl7\" (UniqueName: \"kubernetes.io/projected/cc0df958-8b64-4ae3-beb0-cae2bb572ff5-kube-api-access-tjvl7\") pod \"test-curl-7797-140117713766416\" (UID: \"cc0df958-8b64-4ae3-beb0-cae2bb572ff5\") " pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:14.361167 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.361072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvl7\" (UniqueName: \"kubernetes.io/projected/cc0df958-8b64-4ae3-beb0-cae2bb572ff5-kube-api-access-tjvl7\") pod \"test-curl-7797-140117713766416\" (UID: \"cc0df958-8b64-4ae3-beb0-cae2bb572ff5\") " pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:14.370777 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.370749    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvl7\" (UniqueName: \"kubernetes.io/projected/cc0df958-8b64-4ae3-beb0-cae2bb572ff5-kube-api-access-tjvl7\") pod \"test-curl-7797-140117713766416\" (UID: \"cc0df958-8b64-4ae3-beb0-cae2bb572ff5\") " pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:14.467808 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.467772    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:14.599474 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.599446    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:14.601390 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:14.601364    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc0df958_8b64_4ae3_beb0_cae2bb572ff5.slice/crio-89584acf286478961f7aea0631aaa685f6fe123186f8b54041f8dff302e31c2c WatchSource:0}: Error finding container 89584acf286478961f7aea0631aaa685f6fe123186f8b54041f8dff302e31c2c: Status 404 returned error can't find the container with id 89584acf286478961f7aea0631aaa685f6fe123186f8b54041f8dff302e31c2c
Jul 24 02:15:14.813091 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.813052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713766416" event={"ID":"cc0df958-8b64-4ae3-beb0-cae2bb572ff5","Type":"ContainerStarted","Data":"89584acf286478961f7aea0631aaa685f6fe123186f8b54041f8dff302e31c2c"}
Jul 24 02:15:14.814256 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.814236    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49997930d463cf16644dd7e71d1886299a47331de8506b582d06ffa51ed78498"
Jul 24 02:15:14.814256 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:14.814241    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:14.824797 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:14.824772    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-140117713223088\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="4d08691a-46d4-47bb-9809-215fe049acd2" pod="opendatahub/test-curl-7797-140117713223088"
Jul 24 02:15:15.505610 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:15.505577    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d08691a-46d4-47bb-9809-215fe049acd2" path="/var/lib/kubelet/pods/4d08691a-46d4-47bb-9809-215fe049acd2/volumes"
Jul 24 02:15:15.585359 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:15.585327    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:15:15.824210 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:15.824097    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc0df958-8b64-4ae3-beb0-cae2bb572ff5" containerID="01c67e17e3b0a6197be1a45567d97b5502ae44db5632ded45660f3a9967dd5ef" exitCode=0
Jul 24 02:15:15.824210 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:15.824152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713766416" event={"ID":"cc0df958-8b64-4ae3-beb0-cae2bb572ff5","Type":"ContainerDied","Data":"01c67e17e3b0a6197be1a45567d97b5502ae44db5632ded45660f3a9967dd5ef"}
Jul 24 02:15:16.968987 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:16.968960    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:16.989672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:16.989648    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7797-140117713766416_cc0df958-8b64-4ae3-beb0-cae2bb572ff5/test-curl-7797-140117713766416/0.log"
Jul 24 02:15:17.018820 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.018784    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:17.022712 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.022686    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:17.088844 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.088752    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjvl7\" (UniqueName: \"kubernetes.io/projected/cc0df958-8b64-4ae3-beb0-cae2bb572ff5-kube-api-access-tjvl7\") pod \"cc0df958-8b64-4ae3-beb0-cae2bb572ff5\" (UID: \"cc0df958-8b64-4ae3-beb0-cae2bb572ff5\") "
Jul 24 02:15:17.090813 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.090788    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0df958-8b64-4ae3-beb0-cae2bb572ff5-kube-api-access-tjvl7" (OuterVolumeSpecName: "kube-api-access-tjvl7") pod "cc0df958-8b64-4ae3-beb0-cae2bb572ff5" (UID: "cc0df958-8b64-4ae3-beb0-cae2bb572ff5"). InnerVolumeSpecName "kube-api-access-tjvl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:17.156256 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.156223    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:17.156621 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.156608    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0df958-8b64-4ae3-beb0-cae2bb572ff5" containerName="test-curl-7797-140117713766416"
Jul 24 02:15:17.156665 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.156622    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0df958-8b64-4ae3-beb0-cae2bb572ff5" containerName="test-curl-7797-140117713766416"
Jul 24 02:15:17.156700 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.156690    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0df958-8b64-4ae3-beb0-cae2bb572ff5" containerName="test-curl-7797-140117713766416"
Jul 24 02:15:17.159752 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.159735    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:17.166124 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.166096    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:17.189728 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.189695    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjvl7\" (UniqueName: \"kubernetes.io/projected/cc0df958-8b64-4ae3-beb0-cae2bb572ff5-kube-api-access-tjvl7\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:17.291045 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.291007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp2kf\" (UniqueName: \"kubernetes.io/projected/92f83a35-2dde-48e4-ad90-34f9c10df47c-kube-api-access-pp2kf\") pod \"test-curl-7797-140117713766416\" (UID: \"92f83a35-2dde-48e4-ad90-34f9c10df47c\") " pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:17.391668 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.391585    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp2kf\" (UniqueName: \"kubernetes.io/projected/92f83a35-2dde-48e4-ad90-34f9c10df47c-kube-api-access-pp2kf\") pod \"test-curl-7797-140117713766416\" (UID: \"92f83a35-2dde-48e4-ad90-34f9c10df47c\") " pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:17.400042 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.400006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp2kf\" (UniqueName: \"kubernetes.io/projected/92f83a35-2dde-48e4-ad90-34f9c10df47c-kube-api-access-pp2kf\") pod \"test-curl-7797-140117713766416\" (UID: \"92f83a35-2dde-48e4-ad90-34f9c10df47c\") " pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:17.470071 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.470041    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:17.506750 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.506717    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0df958-8b64-4ae3-beb0-cae2bb572ff5" path="/var/lib/kubelet/pods/cc0df958-8b64-4ae3-beb0-cae2bb572ff5/volumes"
Jul 24 02:15:17.613766 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.613736    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:17.615041 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:17.615012    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92f83a35_2dde_48e4_ad90_34f9c10df47c.slice/crio-36ce213094c6906484499efe4a928879f521b3b288b0d36aab28472a16fb88c7 WatchSource:0}: Error finding container 36ce213094c6906484499efe4a928879f521b3b288b0d36aab28472a16fb88c7: Status 404 returned error can't find the container with id 36ce213094c6906484499efe4a928879f521b3b288b0d36aab28472a16fb88c7
Jul 24 02:15:17.835816 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.835784    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:17.836016 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.835837    2568 scope.go:117] "RemoveContainer" containerID="01c67e17e3b0a6197be1a45567d97b5502ae44db5632ded45660f3a9967dd5ef"
Jul 24 02:15:17.837248 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.837151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713766416" event={"ID":"92f83a35-2dde-48e4-ad90-34f9c10df47c","Type":"ContainerStarted","Data":"36ce213094c6906484499efe4a928879f521b3b288b0d36aab28472a16fb88c7"}
Jul 24 02:15:17.894672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:17.894638    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:18.844208 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:18.844159    2568 generic.go:356] "Generic (PLEG): container finished" podID="92f83a35-2dde-48e4-ad90-34f9c10df47c" containerID="0cd65ca92557ab7502ac5b88a783b9ceb09b6482744ce063f992241dc820e897" exitCode=0
Jul 24 02:15:18.844690 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:18.844217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713766416" event={"ID":"92f83a35-2dde-48e4-ad90-34f9c10df47c","Type":"ContainerDied","Data":"0cd65ca92557ab7502ac5b88a783b9ceb09b6482744ce063f992241dc820e897"}
Jul 24 02:15:19.997246 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:19.997218    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:20.011039 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.010942    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp2kf\" (UniqueName: \"kubernetes.io/projected/92f83a35-2dde-48e4-ad90-34f9c10df47c-kube-api-access-pp2kf\") pod \"92f83a35-2dde-48e4-ad90-34f9c10df47c\" (UID: \"92f83a35-2dde-48e4-ad90-34f9c10df47c\") "
Jul 24 02:15:20.013686 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.013654    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f83a35-2dde-48e4-ad90-34f9c10df47c-kube-api-access-pp2kf" (OuterVolumeSpecName: "kube-api-access-pp2kf") pod "92f83a35-2dde-48e4-ad90-34f9c10df47c" (UID: "92f83a35-2dde-48e4-ad90-34f9c10df47c"). InnerVolumeSpecName "kube-api-access-pp2kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:20.017810 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.017783    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7797-140117713766416_92f83a35-2dde-48e4-ad90-34f9c10df47c/test-curl-7797-140117713766416/0.log"
Jul 24 02:15:20.045719 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.045435    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:20.047446 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.047424    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-140117713766416"]
Jul 24 02:15:20.112326 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.112235    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp2kf\" (UniqueName: \"kubernetes.io/projected/92f83a35-2dde-48e4-ad90-34f9c10df47c-kube-api-access-pp2kf\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:20.675007 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.674949    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr" podUID="3531013e-7d10-4df4-8ea3-40815074c15a" containerName="main" containerID="cri-o://ce8abf7fa6057d05738bb75cd334ac8f5d499e8eb6da628c21adc010912dc185" gracePeriod=45
Jul 24 02:15:20.859847 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.859818    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:20.859847 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.859844    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36ce213094c6906484499efe4a928879f521b3b288b0d36aab28472a16fb88c7"
Jul 24 02:15:20.861673 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.861643    2568 generic.go:356] "Generic (PLEG): container finished" podID="3531013e-7d10-4df4-8ea3-40815074c15a" containerID="ce8abf7fa6057d05738bb75cd334ac8f5d499e8eb6da628c21adc010912dc185" exitCode=0
Jul 24 02:15:20.861817 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.861724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr" event={"ID":"3531013e-7d10-4df4-8ea3-40815074c15a","Type":"ContainerDied","Data":"ce8abf7fa6057d05738bb75cd334ac8f5d499e8eb6da628c21adc010912dc185"}
Jul 24 02:15:20.870980 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:20.870953    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-140117713766416\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="92f83a35-2dde-48e4-ad90-34f9c10df47c" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:20.920696 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:20.920672    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:15:20.939759 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:20.939717    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-140117713766416\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="92f83a35-2dde-48e4-ad90-34f9c10df47c" pod="opendatahub/test-curl-7797-140117713766416"
Jul 24 02:15:21.017712 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.017685    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-model-cache\") pod \"3531013e-7d10-4df4-8ea3-40815074c15a\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") "
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.017727    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-dshm\") pod \"3531013e-7d10-4df4-8ea3-40815074c15a\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") "
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.017748    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-home\") pod \"3531013e-7d10-4df4-8ea3-40815074c15a\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") "
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.017804    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-tmp-dir\") pod \"3531013e-7d10-4df4-8ea3-40815074c15a\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") "
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.017839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3531013e-7d10-4df4-8ea3-40815074c15a-tls-certs\") pod \"3531013e-7d10-4df4-8ea3-40815074c15a\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") "
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.017871    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2htc\" (UniqueName: \"kubernetes.io/projected/3531013e-7d10-4df4-8ea3-40815074c15a-kube-api-access-k2htc\") pod \"3531013e-7d10-4df4-8ea3-40815074c15a\" (UID: \"3531013e-7d10-4df4-8ea3-40815074c15a\") "
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.018023    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-model-cache" (OuterVolumeSpecName: "model-cache") pod "3531013e-7d10-4df4-8ea3-40815074c15a" (UID: "3531013e-7d10-4df4-8ea3-40815074c15a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.018050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3531013e-7d10-4df4-8ea3-40815074c15a" (UID: "3531013e-7d10-4df4-8ea3-40815074c15a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.018155 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.018077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-home" (OuterVolumeSpecName: "home") pod "3531013e-7d10-4df4-8ea3-40815074c15a" (UID: "3531013e-7d10-4df4-8ea3-40815074c15a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.018543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.018205    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.018543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.018225    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.018543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.018239    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.019778 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.019759    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-dshm" (OuterVolumeSpecName: "dshm") pod "3531013e-7d10-4df4-8ea3-40815074c15a" (UID: "3531013e-7d10-4df4-8ea3-40815074c15a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.019961 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.019933    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3531013e-7d10-4df4-8ea3-40815074c15a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3531013e-7d10-4df4-8ea3-40815074c15a" (UID: "3531013e-7d10-4df4-8ea3-40815074c15a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:15:21.020036 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.020021    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3531013e-7d10-4df4-8ea3-40815074c15a-kube-api-access-k2htc" (OuterVolumeSpecName: "kube-api-access-k2htc") pod "3531013e-7d10-4df4-8ea3-40815074c15a" (UID: "3531013e-7d10-4df4-8ea3-40815074c15a"). InnerVolumeSpecName "kube-api-access-k2htc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:21.119331 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.119298    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3531013e-7d10-4df4-8ea3-40815074c15a-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.119331 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.119325    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3531013e-7d10-4df4-8ea3-40815074c15a-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.119331 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.119336    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2htc\" (UniqueName: \"kubernetes.io/projected/3531013e-7d10-4df4-8ea3-40815074c15a-kube-api-access-k2htc\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.505849 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.505818    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f83a35-2dde-48e4-ad90-34f9c10df47c" path="/var/lib/kubelet/pods/92f83a35-2dde-48e4-ad90-34f9c10df47c/volumes"
Jul 24 02:15:21.592064 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.592018    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc" podUID="1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" containerName="main" containerID="cri-o://318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928" gracePeriod=45
Jul 24 02:15:21.846282 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.846259    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:15:21.869619 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.869596    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"
Jul 24 02:15:21.869773 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.869600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr" event={"ID":"3531013e-7d10-4df4-8ea3-40815074c15a","Type":"ContainerDied","Data":"126c2dac0c947de2acee5992f974c527c997c90110f531ec824e428a6f9664bc"}
Jul 24 02:15:21.869773 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.869717    2568 scope.go:117] "RemoveContainer" containerID="ce8abf7fa6057d05738bb75cd334ac8f5d499e8eb6da628c21adc010912dc185"
Jul 24 02:15:21.871325 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.871135    2568 generic.go:356] "Generic (PLEG): container finished" podID="1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" containerID="318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928" exitCode=0
Jul 24 02:15:21.871325 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.871190    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"
Jul 24 02:15:21.871325 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.871267    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc" event={"ID":"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382","Type":"ContainerDied","Data":"318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928"}
Jul 24 02:15:21.871325 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.871301    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc" event={"ID":"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382","Type":"ContainerDied","Data":"2d5a72ad1d4cd897ce36e00790383894ca48b03b16e60454ed709f27a747e85d"}
Jul 24 02:15:21.878615 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.878595    2568 scope.go:117] "RemoveContainer" containerID="318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928"
Jul 24 02:15:21.886822 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.886802    2568 scope.go:117] "RemoveContainer" containerID="318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928"
Jul 24 02:15:21.887107 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:21.887076    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928\": container with ID starting with 318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928 not found: ID does not exist" containerID="318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928"
Jul 24 02:15:21.887187 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.887110    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928"} err="failed to get container status \"318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928\": rpc error: code = NotFound desc = could not find container \"318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928\": container with ID starting with 318f55deec25025f0a129fa709311ab330be2d691431c90b179728ad01791928 not found: ID does not exist"
Jul 24 02:15:21.887777 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.887760    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"]
Jul 24 02:15:21.890725 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.890700    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6bcabd/rate-test-model-6bcabd-kserve-669d4dc84c-sf4fr"]
Jul 24 02:15:21.927277 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927253    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jldhb\" (UniqueName: \"kubernetes.io/projected/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-kube-api-access-jldhb\") pod \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") "
Jul 24 02:15:21.927431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927298    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tls-certs\") pod \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") "
Jul 24 02:15:21.927431 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927328    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-model-cache\") pod \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") "
Jul 24 02:15:21.927540 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-home\") pod \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") "
Jul 24 02:15:21.927604 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927550    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-dshm\") pod \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") "
Jul 24 02:15:21.927604 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927581    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" (UID: "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.927706 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927587    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tmp-dir\") pod \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\" (UID: \"1ca553c7-27ff-4adb-b6e4-d2df9e5bb382\") "
Jul 24 02:15:21.927776 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927751    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-home" (OuterVolumeSpecName: "home") pod "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" (UID: "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.927827 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.927796    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" (UID: "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:21.928050 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.928029    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.928139 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.928052    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.928139 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.928065    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:21.929437 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.929407    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-kube-api-access-jldhb" (OuterVolumeSpecName: "kube-api-access-jldhb") pod "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" (UID: "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382"). InnerVolumeSpecName "kube-api-access-jldhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:21.929543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.929497    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" (UID: "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:15:21.929543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:21.929505    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-dshm" (OuterVolumeSpecName: "dshm") pod "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" (UID: "1ca553c7-27ff-4adb-b6e4-d2df9e5bb382"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:15:22.029004 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:22.028931    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jldhb\" (UniqueName: \"kubernetes.io/projected/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-kube-api-access-jldhb\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:22.029004 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:22.028963    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:22.029004 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:22.028980    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:22.194753 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:22.194721    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"]
Jul 24 02:15:22.199864 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:22.199837    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a7fbc1/rate-test-model-a7fbc1-kserve-77bbd6f759-mxjsc"]
Jul 24 02:15:23.410915 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.410881    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7797-140117713073616"]
Jul 24 02:15:23.411307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411262    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" containerName="main"
Jul 24 02:15:23.411307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411274    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" containerName="main"
Jul 24 02:15:23.411307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411296    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3531013e-7d10-4df4-8ea3-40815074c15a" containerName="main"
Jul 24 02:15:23.411307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411301    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3531013e-7d10-4df4-8ea3-40815074c15a" containerName="main"
Jul 24 02:15:23.411307 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411307    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f83a35-2dde-48e4-ad90-34f9c10df47c" containerName="test-curl-7797-140117713766416"
Jul 24 02:15:23.411483 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411315    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f83a35-2dde-48e4-ad90-34f9c10df47c" containerName="test-curl-7797-140117713766416"
Jul 24 02:15:23.411483 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411370    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3531013e-7d10-4df4-8ea3-40815074c15a" containerName="main"
Jul 24 02:15:23.411483 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411377    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f83a35-2dde-48e4-ad90-34f9c10df47c" containerName="test-curl-7797-140117713766416"
Jul 24 02:15:23.411483 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.411385    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" containerName="main"
Jul 24 02:15:23.415942 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.415922    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:23.418269 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.418247    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q8hnt\""
Jul 24 02:15:23.420506 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.420484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713073616"]
Jul 24 02:15:23.441291 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.441268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6bj8\" (UniqueName: \"kubernetes.io/projected/858ac041-1bc5-4c28-8ae7-e1b7159121de-kube-api-access-b6bj8\") pod \"test-curl-7797-140117713073616\" (UID: \"858ac041-1bc5-4c28-8ae7-e1b7159121de\") " pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:23.507409 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.507378    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca553c7-27ff-4adb-b6e4-d2df9e5bb382" path="/var/lib/kubelet/pods/1ca553c7-27ff-4adb-b6e4-d2df9e5bb382/volumes"
Jul 24 02:15:23.507892 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.507873    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3531013e-7d10-4df4-8ea3-40815074c15a" path="/var/lib/kubelet/pods/3531013e-7d10-4df4-8ea3-40815074c15a/volumes"
Jul 24 02:15:23.541883 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.541854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6bj8\" (UniqueName: \"kubernetes.io/projected/858ac041-1bc5-4c28-8ae7-e1b7159121de-kube-api-access-b6bj8\") pod \"test-curl-7797-140117713073616\" (UID: \"858ac041-1bc5-4c28-8ae7-e1b7159121de\") " pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:23.549474 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.549445    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6bj8\" (UniqueName: \"kubernetes.io/projected/858ac041-1bc5-4c28-8ae7-e1b7159121de-kube-api-access-b6bj8\") pod \"test-curl-7797-140117713073616\" (UID: \"858ac041-1bc5-4c28-8ae7-e1b7159121de\") " pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:23.738586 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.738555    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:23.866343 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.866320    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7797-140117713073616"]
Jul 24 02:15:23.868666 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:23.868639    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod858ac041_1bc5_4c28_8ae7_e1b7159121de.slice/crio-a2aa64501e7c426bdbc105ed260b0358881d5c9b34144725b373235a465c7419 WatchSource:0}: Error finding container a2aa64501e7c426bdbc105ed260b0358881d5c9b34144725b373235a465c7419: Status 404 returned error can't find the container with id a2aa64501e7c426bdbc105ed260b0358881d5c9b34144725b373235a465c7419
Jul 24 02:15:23.883989 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:23.883963    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713073616" event={"ID":"858ac041-1bc5-4c28-8ae7-e1b7159121de","Type":"ContainerStarted","Data":"a2aa64501e7c426bdbc105ed260b0358881d5c9b34144725b373235a465c7419"}
Jul 24 02:15:24.892512 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:24.892424    2568 generic.go:356] "Generic (PLEG): container finished" podID="858ac041-1bc5-4c28-8ae7-e1b7159121de" containerID="032ca8dada2cc884b61e3b376544b044f43e699eb66f6b64373e794adfc28c5e" exitCode=0
Jul 24 02:15:24.892512 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:24.892474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7797-140117713073616" event={"ID":"858ac041-1bc5-4c28-8ae7-e1b7159121de","Type":"ContainerDied","Data":"032ca8dada2cc884b61e3b376544b044f43e699eb66f6b64373e794adfc28c5e"}
Jul 24 02:15:26.036751 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.036723    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:26.056572 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.056544    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7797-140117713073616_858ac041-1bc5-4c28-8ae7-e1b7159121de/test-curl-7797-140117713073616/0.log"
Jul 24 02:15:26.064778 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.064755    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6bj8\" (UniqueName: \"kubernetes.io/projected/858ac041-1bc5-4c28-8ae7-e1b7159121de-kube-api-access-b6bj8\") pod \"858ac041-1bc5-4c28-8ae7-e1b7159121de\" (UID: \"858ac041-1bc5-4c28-8ae7-e1b7159121de\") "
Jul 24 02:15:26.066785 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.066760    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858ac041-1bc5-4c28-8ae7-e1b7159121de-kube-api-access-b6bj8" (OuterVolumeSpecName: "kube-api-access-b6bj8") pod "858ac041-1bc5-4c28-8ae7-e1b7159121de" (UID: "858ac041-1bc5-4c28-8ae7-e1b7159121de"). InnerVolumeSpecName "kube-api-access-b6bj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:15:26.083543 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.083517    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7797-140117713073616"]
Jul 24 02:15:26.087542 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.087513    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7797-140117713073616"]
Jul 24 02:15:26.165805 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.165725    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6bj8\" (UniqueName: \"kubernetes.io/projected/858ac041-1bc5-4c28-8ae7-e1b7159121de-kube-api-access-b6bj8\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:15:26.615046 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.615015    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:26.905022 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.904922    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:26.905022 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.904952    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2aa64501e7c426bdbc105ed260b0358881d5c9b34144725b373235a465c7419"
Jul 24 02:15:26.915557 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.915530    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"]
Jul 24 02:15:26.916080 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.915962    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" containerName="test-curl-7797-140117713073616"
Jul 24 02:15:26.916080 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.915979    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" containerName="test-curl-7797-140117713073616"
Jul 24 02:15:26.916238 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.916084    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" containerName="test-curl-7797-140117713073616"
Jul 24 02:15:26.918851 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:26.918826    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-140117713073616\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:26.919466 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.919448    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.921720 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.921703    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a002f7-openshift-default-dockercfg-vcrkd\""
Jul 24 02:15:26.931105 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.931085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"]
Jul 24 02:15:26.946083 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.946050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:26.952062 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:26.952029    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-140117713073616\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:26.972772 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-socket\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.972895 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-data\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.972895 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-envoy\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.972895 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-podinfo\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.973009 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972920    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-credential-socket\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.973009 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nttc8\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-kube-api-access-nttc8\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.973009 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.972977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-certs\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.973118 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.973011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd07cd13-c144-4c7b-a3de-56d53798afe1-istiod-ca-cert\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:26.973118 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:26.973067    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-token\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.073806 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-podinfo\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.073806 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-credential-socket\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nttc8\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-kube-api-access-nttc8\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-certs\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073901    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd07cd13-c144-4c7b-a3de-56d53798afe1-istiod-ca-cert\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-token\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.073966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-socket\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-data\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074267    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-envoy\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074375 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-socket\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074769 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-certs\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074769 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074563    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-data\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074769 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-credential-socket\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.074769 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.074694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd07cd13-c144-4c7b-a3de-56d53798afe1-istiod-ca-cert\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.076390 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.076373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-podinfo\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.076390 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.076383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-envoy\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.081374 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.081353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-token\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.081473 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.081460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nttc8\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-kube-api-access-nttc8\") pod \"e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") " pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.230550 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.230505    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:27.379373 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.379343    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"]
Jul 24 02:15:27.381641 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:27.381612    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd07cd13_c144_4c7b_a3de_56d53798afe1.slice/crio-00a1f8db49660d406ab55b76e7dce86ffbbbdb66d693f1e7eaab8e1f5c0d2a07 WatchSource:0}: Error finding container 00a1f8db49660d406ab55b76e7dce86ffbbbdb66d693f1e7eaab8e1f5c0d2a07: Status 404 returned error can't find the container with id 00a1f8db49660d406ab55b76e7dce86ffbbbdb66d693f1e7eaab8e1f5c0d2a07
Jul 24 02:15:27.384370 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.384334    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:27.384461 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.384420    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:27.384504 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.384459    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:27.407672 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.407645    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:27.505069 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:15:27.504988    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7797-140117713073616\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" pod="opendatahub/test-curl-7797-140117713073616"
Jul 24 02:15:27.507922 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.507889    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858ac041-1bc5-4c28-8ae7-e1b7159121de" path="/var/lib/kubelet/pods/858ac041-1bc5-4c28-8ae7-e1b7159121de/volumes"
Jul 24 02:15:27.912032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.911937    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" event={"ID":"dd07cd13-c144-4c7b-a3de-56d53798afe1","Type":"ContainerStarted","Data":"03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"}
Jul 24 02:15:27.912032 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.911988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" event={"ID":"dd07cd13-c144-4c7b-a3de-56d53798afe1","Type":"ContainerStarted","Data":"00a1f8db49660d406ab55b76e7dce86ffbbbdb66d693f1e7eaab8e1f5c0d2a07"}
Jul 24 02:15:27.932853 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:27.932802    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podStartSLOduration=1.932783752 podStartE2EDuration="1.932783752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:15:27.931326263 +0000 UTC m=+2740.955725038" watchObservedRunningTime="2026-07-24 02:15:27.932783752 +0000 UTC m=+2740.957182232"
Jul 24 02:15:28.231609 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:28.231568    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:28.236781 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:28.236753    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:28.916560 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:28.916531    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:28.917545 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:28.917525    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:30.164247 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:30.164197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:30.264247 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:30.264215    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:31.253976 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:31.253945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:31.395105 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:31.395065    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:31.757794 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:31.757763    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:31.847995 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:31.847957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:34.666048 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:34.666015    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:38.488213 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:38.488159    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:15:44.958399 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:44.958345    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 02:15:44.958856 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:44.958435    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 02:15:45.499676 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.499641    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:45.786595 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.786499    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"]
Jul 24 02:15:45.792546 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.792521    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.794921 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.794903    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-477d74-openshift-default-dockercfg-2fkf6\""
Jul 24 02:15:45.802192 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.802153    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"]
Jul 24 02:15:45.811054 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.811025    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:45.861569 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-token\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0682ead6-a00a-435c-a924-63edeb83eaf4-istiod-ca-cert\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-socket\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-credential-socket\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861758 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-certs\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861768    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-envoy\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861799    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flz67\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-kube-api-access-flz67\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-data\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.861955 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.861893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-podinfo\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963203 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0682ead6-a00a-435c-a924-63edeb83eaf4-istiod-ca-cert\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-socket\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-credential-socket\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-certs\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963345    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-envoy\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flz67\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-kube-api-access-flz67\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-data\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-podinfo\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.963684 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-token\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.964083 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963704    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-certs\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.964083 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963775    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-credential-socket\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.964083 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.963996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0682ead6-a00a-435c-a924-63edeb83eaf4-istiod-ca-cert\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.964083 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.964036    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-data\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.964313 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.964070    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-socket\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.966067 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.966040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-envoy\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.966265 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.966249    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-podinfo\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.971050 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.971029    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flz67\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-kube-api-access-flz67\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:45.971421 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:45.971401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-token\") pod \"e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") " pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:46.053058 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:46.052972    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:46.104336 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:46.104302    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:46.247647 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:46.247616    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"]
Jul 24 02:15:46.248689 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:15:46.248660    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0682ead6_a00a_435c_a924_63edeb83eaf4.slice/crio-60c47c29a06157d5aaf20cefd4648af168623ff2cbb43861967303039cd161fc WatchSource:0}: Error finding container 60c47c29a06157d5aaf20cefd4648af168623ff2cbb43861967303039cd161fc: Status 404 returned error can't find the container with id 60c47c29a06157d5aaf20cefd4648af168623ff2cbb43861967303039cd161fc
Jul 24 02:15:46.251001 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:46.250966    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:46.251089 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:46.251031    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:46.251089 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:46.251065    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:47.011682 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.011650    2568 generic.go:356] "Generic (PLEG): container finished" podID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerID="03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0" exitCode=0
Jul 24 02:15:47.012237 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.011728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" event={"ID":"dd07cd13-c144-4c7b-a3de-56d53798afe1","Type":"ContainerDied","Data":"03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"}
Jul 24 02:15:47.012315 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.012287    2568 scope.go:117] "RemoveContainer" containerID="03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"
Jul 24 02:15:47.013398 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.013370    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" event={"ID":"0682ead6-a00a-435c-a924-63edeb83eaf4","Type":"ContainerStarted","Data":"a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"}
Jul 24 02:15:47.013498 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.013425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" event={"ID":"0682ead6-a00a-435c-a924-63edeb83eaf4","Type":"ContainerStarted","Data":"60c47c29a06157d5aaf20cefd4648af168623ff2cbb43861967303039cd161fc"}
Jul 24 02:15:47.013498 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.013419    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:47.013585 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.013509    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:47.013585 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.013544    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:15:47.058774 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.058722    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" podStartSLOduration=2.058703843 podStartE2EDuration="2.058703843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:15:47.058033848 +0000 UTC m=+2760.082432326" watchObservedRunningTime="2026-07-24 02:15:47.058703843 +0000 UTC m=+2760.083102320"
Jul 24 02:15:47.105160 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.105124    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:47.111679 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:47.111652    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:48.020780 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.020743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" event={"ID":"dd07cd13-c144-4c7b-a3de-56d53798afe1","Type":"ContainerStarted","Data":"5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6"}
Jul 24 02:15:48.021231 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.021096    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:48.022099 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.022080    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:15:48.234201 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.233344    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:48.234201 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.233625    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 02:15:48.234201 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.233705    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 02:15:48.991728 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:48.991696    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:49.090234 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:49.090163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:49.231351 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:49.231308    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 02:15:49.231561 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:49.231376    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 02:15:50.231260 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:50.231221    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 02:15:50.231849 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:50.231818    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 02:15:50.870246 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:50.870214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:51.015642 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.015611    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:51.231326 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.231291    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 24 02:15:51.231923 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.231891    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 24 02:15:51.447881 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.447821    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:51.542259 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.540561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:51.831913 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.831812    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:51.932605 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:51.932575    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:52.234501 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:52.234471    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:52.234920 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:52.234769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:52.235568 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:52.235546    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:15:53.513979 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:53.513945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:15:59.387273 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:15:59.387236    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:16:07.120404 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:07.120377    2568 generic.go:356] "Generic (PLEG): container finished" podID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerID="a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b" exitCode=0
Jul 24 02:16:07.120759 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:07.120457    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" event={"ID":"0682ead6-a00a-435c-a924-63edeb83eaf4","Type":"ContainerDied","Data":"a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"}
Jul 24 02:16:07.120927 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:07.120907    2568 scope.go:117] "RemoveContainer" containerID="a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"
Jul 24 02:16:07.122189 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:07.122144    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:16:07.122273 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:07.122247    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:16:07.122327 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:07.122292    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 02:16:08.128406 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:08.128371    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" event={"ID":"0682ead6-a00a-435c-a924-63edeb83eaf4","Type":"ContainerStarted","Data":"9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131"}
Jul 24 02:16:09.105477 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:09.105437    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:16:09.105662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:09.105598    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 02:16:09.105662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:09.105640    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 02:16:10.105425 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:10.105391    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 02:16:10.105830 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:10.105449    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 02:16:11.105301 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:11.105268    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 24 02:16:11.105513 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:11.105355    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 24 02:16:12.109006 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:12.108972    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:16:12.109419 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:12.109256    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:16:12.109997 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:12.109979    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:16:24.955248 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.955165    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"]
Jul 24 02:16:24.959272 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.959246    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:24.961780 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.961737    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a002f7\"/\"kube-root-ca.crt\""
Jul 24 02:16:24.962674 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.962654    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a002f7\"/\"openshift-service-ca.crt\""
Jul 24 02:16:24.962788 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.962677    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a002f7\"/\"default-dockercfg-fzr46\""
Jul 24 02:16:24.962788 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.962654    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a002f7\"/\"ipp-route-a002f7-kserve-self-signed-certs\""
Jul 24 02:16:24.969082 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.969056    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"]
Jul 24 02:16:24.985067 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:24.985034    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:16:25.062523 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.062482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-model-cache\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.062715 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.062540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-tmp-dir\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.062715 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.062565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6be9ba2-2509-42af-b902-d5134b7d73c7-tls-certs\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.062715 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.062618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-dshm\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.062715 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.062650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98khq\" (UniqueName: \"kubernetes.io/projected/c6be9ba2-2509-42af-b902-d5134b7d73c7-kube-api-access-98khq\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.062856 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.062714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-home\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164016 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.163983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-home\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164222 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-model-cache\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164222 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-tmp-dir\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164222 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6be9ba2-2509-42af-b902-d5134b7d73c7-tls-certs\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164381 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-dshm\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164381 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98khq\" (UniqueName: \"kubernetes.io/projected/c6be9ba2-2509-42af-b902-d5134b7d73c7-kube-api-access-98khq\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164554 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164530    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-home\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164554 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164545    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-model-cache\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.164811 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.164794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-tmp-dir\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.167388 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.167361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-dshm\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.169239 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.169212    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6be9ba2-2509-42af-b902-d5134b7d73c7-tls-certs\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.172252 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.172229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98khq\" (UniqueName: \"kubernetes.io/projected/c6be9ba2-2509-42af-b902-d5134b7d73c7-kube-api-access-98khq\") pod \"ipp-route-a002f7-kserve-56d969df6c-4j87x\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") " pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.279860 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.279758    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:25.416300 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:25.416266    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"]
Jul 24 02:16:25.417723 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:16:25.417696    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6be9ba2_2509_42af_b902_d5134b7d73c7.slice/crio-d23ab26b01afa5651377fda977c05507970085bb047a7d599ae7b165b4d8aad7 WatchSource:0}: Error finding container d23ab26b01afa5651377fda977c05507970085bb047a7d599ae7b165b4d8aad7: Status 404 returned error can't find the container with id d23ab26b01afa5651377fda977c05507970085bb047a7d599ae7b165b4d8aad7
Jul 24 02:16:26.229392 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:26.229361    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x" event={"ID":"c6be9ba2-2509-42af-b902-d5134b7d73c7","Type":"ContainerStarted","Data":"12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58"}
Jul 24 02:16:26.229813 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:26.229400    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x" event={"ID":"c6be9ba2-2509-42af-b902-d5134b7d73c7","Type":"ContainerStarted","Data":"d23ab26b01afa5651377fda977c05507970085bb047a7d599ae7b165b4d8aad7"}
Jul 24 02:16:26.248833 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:26.248769    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x" podStartSLOduration=2.248739722 podStartE2EDuration="2.248739722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:16:26.246625586 +0000 UTC m=+2799.271024076" watchObservedRunningTime="2026-07-24 02:16:26.248739722 +0000 UTC m=+2799.273138199"
Jul 24 02:16:29.091422 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:29.091385    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:16:35.280115 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:35.280081    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:35.280115 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:35.280125    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:35.292802 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:35.292773    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:36.293733 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:36.293701    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:16:41.481819 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:41.481783    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:16:56.018763 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:56.018728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:16:56.114484 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:56.114450    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:16:58.279070 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:58.279041    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:16:58.657435 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:58.657330    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:16:58.894757 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:16:58.894719    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:01.701208 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:01.701148    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:01.797397 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:01.797362    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:04.291705 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:04.291667    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:04.453351 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:04.453325    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:04.832903 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:04.832861    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:04.917422 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:04.917381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:06.237655 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:06.237615    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:12.690587 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:12.690555    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:17:35.299759 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:35.299717    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:35.444910 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:35.444873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:35.500954 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:35.500876    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:37.483890 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:37.483853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:37.860245 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:37.860141    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:39.495330 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:39.495247    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:17:43.855309 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:43.855272    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:43.956251 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:43.956216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:44.180039 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:44.179948    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:17:44.420646 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:17:44.420612    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:05.087242 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:05.087206    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:18:08.453558 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:08.453520    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:10.100277 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:10.100242    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:13.285421 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:13.285388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:13.616052 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:13.615969    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:18.595756 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:18.595719    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"]
Jul 24 02:18:18.692296 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:18.692264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:20.780302 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:20.780265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:18:33.615112 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.615069    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x" podUID="c6be9ba2-2509-42af-b902-d5134b7d73c7" containerName="main" containerID="cri-o://12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58" gracePeriod=45
Jul 24 02:18:33.863720 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.863696    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:18:33.902909 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.902814    2568 generic.go:356] "Generic (PLEG): container finished" podID="c6be9ba2-2509-42af-b902-d5134b7d73c7" containerID="12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58" exitCode=0
Jul 24 02:18:33.902909 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.902851    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"
Jul 24 02:18:33.902909 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.902898    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x" event={"ID":"c6be9ba2-2509-42af-b902-d5134b7d73c7","Type":"ContainerDied","Data":"12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58"}
Jul 24 02:18:33.903197 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.902942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x" event={"ID":"c6be9ba2-2509-42af-b902-d5134b7d73c7","Type":"ContainerDied","Data":"d23ab26b01afa5651377fda977c05507970085bb047a7d599ae7b165b4d8aad7"}
Jul 24 02:18:33.903197 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.902965    2568 scope.go:117] "RemoveContainer" containerID="12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58"
Jul 24 02:18:33.911724 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.911707    2568 scope.go:117] "RemoveContainer" containerID="12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58"
Jul 24 02:18:33.912013 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:18:33.911992    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58\": container with ID starting with 12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58 not found: ID does not exist" containerID="12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58"
Jul 24 02:18:33.912087 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.912022    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58"} err="failed to get container status \"12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58\": rpc error: code = NotFound desc = could not find container \"12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58\": container with ID starting with 12d001b87190541b863ac513a9b60b4a131f41a00caefe22b461e170bab68d58 not found: ID does not exist"
Jul 24 02:18:33.953289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-tmp-dir\") pod \"c6be9ba2-2509-42af-b902-d5134b7d73c7\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") "
Jul 24 02:18:33.953434 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953343    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-model-cache\") pod \"c6be9ba2-2509-42af-b902-d5134b7d73c7\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") "
Jul 24 02:18:33.953434 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953368    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-home\") pod \"c6be9ba2-2509-42af-b902-d5134b7d73c7\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") "
Jul 24 02:18:33.953434 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98khq\" (UniqueName: \"kubernetes.io/projected/c6be9ba2-2509-42af-b902-d5134b7d73c7-kube-api-access-98khq\") pod \"c6be9ba2-2509-42af-b902-d5134b7d73c7\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") "
Jul 24 02:18:33.953614 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953443    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6be9ba2-2509-42af-b902-d5134b7d73c7-tls-certs\") pod \"c6be9ba2-2509-42af-b902-d5134b7d73c7\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") "
Jul 24 02:18:33.953614 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953460    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-dshm\") pod \"c6be9ba2-2509-42af-b902-d5134b7d73c7\" (UID: \"c6be9ba2-2509-42af-b902-d5134b7d73c7\") "
Jul 24 02:18:33.953614 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953544    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6be9ba2-2509-42af-b902-d5134b7d73c7" (UID: "c6be9ba2-2509-42af-b902-d5134b7d73c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:18:33.953753 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6be9ba2-2509-42af-b902-d5134b7d73c7" (UID: "c6be9ba2-2509-42af-b902-d5134b7d73c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:18:33.953753 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953650    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-home" (OuterVolumeSpecName: "home") pod "c6be9ba2-2509-42af-b902-d5134b7d73c7" (UID: "c6be9ba2-2509-42af-b902-d5134b7d73c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:18:33.953867 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953846    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-model-cache\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:18:33.953867 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953866    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-home\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:18:33.953983 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.953875    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-tmp-dir\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:18:33.955708 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.955679    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6be9ba2-2509-42af-b902-d5134b7d73c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6be9ba2-2509-42af-b902-d5134b7d73c7" (UID: "c6be9ba2-2509-42af-b902-d5134b7d73c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 02:18:33.955807 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.955722    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-dshm" (OuterVolumeSpecName: "dshm") pod "c6be9ba2-2509-42af-b902-d5134b7d73c7" (UID: "c6be9ba2-2509-42af-b902-d5134b7d73c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:18:33.955807 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:33.955732    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6be9ba2-2509-42af-b902-d5134b7d73c7-kube-api-access-98khq" (OuterVolumeSpecName: "kube-api-access-98khq") pod "c6be9ba2-2509-42af-b902-d5134b7d73c7" (UID: "c6be9ba2-2509-42af-b902-d5134b7d73c7"). InnerVolumeSpecName "kube-api-access-98khq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:18:34.054910 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:34.054874    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6be9ba2-2509-42af-b902-d5134b7d73c7-tls-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:18:34.054910 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:34.054902    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6be9ba2-2509-42af-b902-d5134b7d73c7-dshm\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:18:34.054910 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:34.054914    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98khq\" (UniqueName: \"kubernetes.io/projected/c6be9ba2-2509-42af-b902-d5134b7d73c7-kube-api-access-98khq\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:18:34.224701 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:34.224672    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"]
Jul 24 02:18:34.229530 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:34.229503    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-a002f7/ipp-route-a002f7-kserve-56d969df6c-4j87x"]
Jul 24 02:18:35.507832 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:35.507792    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6be9ba2-2509-42af-b902-d5134b7d73c7" path="/var/lib/kubelet/pods/c6be9ba2-2509-42af-b902-d5134b7d73c7/volumes"
Jul 24 02:18:56.054345 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:56.054315    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:18:56.173602 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:18:56.173567    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:02.067512 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:02.067476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:02.169108 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:02.169064    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:02.341226 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:02.341121    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"]
Jul 24 02:19:02.341387 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:02.341358    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" containerID="cri-o://5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6" gracePeriod=30
Jul 24 02:19:02.364076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:02.364042    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:02.629088 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:02.629014    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:07.237550 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.237510    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 02:19:07.237945 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.237589    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 02:19:07.602191 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.602155    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:19:07.693385 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693353    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd07cd13-c144-4c7b-a3de-56d53798afe1-istiod-ca-cert\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693412    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-podinfo\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693455    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nttc8\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-kube-api-access-nttc8\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693475    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-credential-socket\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-token\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693548    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-certs\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693570 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693567    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-data\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693876 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693612    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-envoy\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693876 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693656    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-socket\") pod \"dd07cd13-c144-4c7b-a3de-56d53798afe1\" (UID: \"dd07cd13-c144-4c7b-a3de-56d53798afe1\") "
Jul 24 02:19:07.693997 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693891    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:07.693997 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.693903    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd07cd13-c144-4c7b-a3de-56d53798afe1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:19:07.694104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.694001    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:07.694104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.694060    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd07cd13-c144-4c7b-a3de-56d53798afe1-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.694104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.694080    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.694304 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.694104    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:07.694679 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.694656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:07.695777 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.695749    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:19:07.695878 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.695786    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-kube-api-access-nttc8" (OuterVolumeSpecName: "kube-api-access-nttc8") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "kube-api-access-nttc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:19:07.696050 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.696028    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:19:07.696094 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.696049    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd07cd13-c144-4c7b-a3de-56d53798afe1" (UID: "dd07cd13-c144-4c7b-a3de-56d53798afe1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794584    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794609    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794618    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794625    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd07cd13-c144-4c7b-a3de-56d53798afe1-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794634    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794643    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nttc8\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-kube-api-access-nttc8\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:07.794662 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:07.794652    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd07cd13-c144-4c7b-a3de-56d53798afe1-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:08.076703 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.076614    2568 generic.go:356] "Generic (PLEG): container finished" podID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerID="5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6" exitCode=0
Jul 24 02:19:08.076703 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.076661    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"
Jul 24 02:19:08.076918 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.076696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" event={"ID":"dd07cd13-c144-4c7b-a3de-56d53798afe1","Type":"ContainerDied","Data":"5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6"}
Jul 24 02:19:08.076918 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.076749    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9" event={"ID":"dd07cd13-c144-4c7b-a3de-56d53798afe1","Type":"ContainerDied","Data":"00a1f8db49660d406ab55b76e7dce86ffbbbdb66d693f1e7eaab8e1f5c0d2a07"}
Jul 24 02:19:08.076918 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.076772    2568 scope.go:117] "RemoveContainer" containerID="5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6"
Jul 24 02:19:08.086562 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.086549    2568 scope.go:117] "RemoveContainer" containerID="03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"
Jul 24 02:19:08.094593 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.094577    2568 scope.go:117] "RemoveContainer" containerID="5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6"
Jul 24 02:19:08.094819 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:19:08.094804    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6\": container with ID starting with 5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6 not found: ID does not exist" containerID="5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6"
Jul 24 02:19:08.094864 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.094826    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6"} err="failed to get container status \"5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6\": rpc error: code = NotFound desc = could not find container \"5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6\": container with ID starting with 5f9e5ca37bf4c7624627ceae7b02d55c3c0aebd8dc05840c29253603198df4f6 not found: ID does not exist"
Jul 24 02:19:08.094864 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.094842    2568 scope.go:117] "RemoveContainer" containerID="03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"
Jul 24 02:19:08.095082 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:19:08.095062    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0\": container with ID starting with 03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0 not found: ID does not exist" containerID="03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"
Jul 24 02:19:08.095132 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.095089    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0"} err="failed to get container status \"03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0\": rpc error: code = NotFound desc = could not find container \"03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0\": container with ID starting with 03469a3b69109c42c5febb4f111cc479ef34e5c5fbffb656e435725617d048b0 not found: ID does not exist"
Jul 24 02:19:08.098852 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.098831    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"]
Jul 24 02:19:08.102593 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:08.102573    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a002f7-openshift-default-5556644bb6-rtvd9"]
Jul 24 02:19:09.505347 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:09.505256    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" path="/var/lib/kubelet/pods/dd07cd13-c144-4c7b-a3de-56d53798afe1/volumes"
Jul 24 02:19:09.604062 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:09.604023    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:13.792551 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:13.792506    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:13.910897 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:13.910870    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:13.968823 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:13.968778    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:16.981666 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:16.981625    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:19:17.891469 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:17.891436    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:18.315645 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:18.315611    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:24.154267 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:24.154231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:24.224538 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:24.224488    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:24.454372 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:24.454337    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"]
Jul 24 02:19:24.454938 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:24.454905    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy" containerID="cri-o://9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131" gracePeriod=30
Jul 24 02:19:24.462757 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:24.462736    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:24.694367 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:24.694329    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:27.111834 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:27.111791    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 02:19:27.112247 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:27.111845    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 02:19:29.711735 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.711712    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:19:29.808879 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.808778    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-data\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.808879 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.808832    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-socket\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.808879 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.808877    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0682ead6-a00a-435c-a924-63edeb83eaf4-istiod-ca-cert\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809170 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.808965    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-podinfo\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809170 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809006    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-token\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809170 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809130    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-credential-socket\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809170 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809143    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:29.809414 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-certs\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809414 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809256    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flz67\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-kube-api-access-flz67\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809414 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809294    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-envoy\") pod \"0682ead6-a00a-435c-a924-63edeb83eaf4\" (UID: \"0682ead6-a00a-435c-a924-63edeb83eaf4\") "
Jul 24 02:19:29.809721 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809476    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0682ead6-a00a-435c-a924-63edeb83eaf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:19:29.809813 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809780    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:29.809884 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809809    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:29.809884 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.809815    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:29.811829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.810555    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.811829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.810584    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.811829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.810600    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.811829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.810614    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.811829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.810634    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0682ead6-a00a-435c-a924-63edeb83eaf4-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.812711 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.812685    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:19:29.819104 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.819077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:19:29.819713 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.819501    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-kube-api-access-flz67" (OuterVolumeSpecName: "kube-api-access-flz67") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "kube-api-access-flz67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:19:29.819980 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.819853    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "0682ead6-a00a-435c-a924-63edeb83eaf4" (UID: "0682ead6-a00a-435c-a924-63edeb83eaf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:19:29.911749 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.911695    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.911749 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.911743    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.911749 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.911754    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flz67\" (UniqueName: \"kubernetes.io/projected/0682ead6-a00a-435c-a924-63edeb83eaf4-kube-api-access-flz67\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:29.911749 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:29.911765    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0682ead6-a00a-435c-a924-63edeb83eaf4-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:19:30.194966 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.194932    2568 generic.go:356] "Generic (PLEG): container finished" podID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerID="9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131" exitCode=0
Jul 24 02:19:30.195137 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.195002    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"
Jul 24 02:19:30.195137 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.195020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" event={"ID":"0682ead6-a00a-435c-a924-63edeb83eaf4","Type":"ContainerDied","Data":"9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131"}
Jul 24 02:19:30.195137 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.195116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq" event={"ID":"0682ead6-a00a-435c-a924-63edeb83eaf4","Type":"ContainerDied","Data":"60c47c29a06157d5aaf20cefd4648af168623ff2cbb43861967303039cd161fc"}
Jul 24 02:19:30.195265 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.195148    2568 scope.go:117] "RemoveContainer" containerID="9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131"
Jul 24 02:19:30.208335 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.208313    2568 scope.go:117] "RemoveContainer" containerID="a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"
Jul 24 02:19:30.216917 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.216894    2568 scope.go:117] "RemoveContainer" containerID="9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131"
Jul 24 02:19:30.217271 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:19:30.217226    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131\": container with ID starting with 9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131 not found: ID does not exist" containerID="9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131"
Jul 24 02:19:30.217372 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.217276    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131"} err="failed to get container status \"9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131\": rpc error: code = NotFound desc = could not find container \"9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131\": container with ID starting with 9c031d0097f1bf0399266a36950d113882ff452c190217bf91b708abc7b73131 not found: ID does not exist"
Jul 24 02:19:30.217372 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.217295    2568 scope.go:117] "RemoveContainer" containerID="a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"
Jul 24 02:19:30.217564 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:19:30.217553    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b\": container with ID starting with a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b not found: ID does not exist" containerID="a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"
Jul 24 02:19:30.217618 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.217573    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b"} err="failed to get container status \"a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b\": rpc error: code = NotFound desc = could not find container \"a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b\": container with ID starting with a938a1a882ac26b3025671a5225f9980d7d0ce6bfa7b5b0eaf363067af28500b not found: ID does not exist"
Jul 24 02:19:30.218844 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.218825    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"]
Jul 24 02:19:30.224798 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:30.224776    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-477d74-openshift-default-7dd6f47874-9gxxq"]
Jul 24 02:19:31.505134 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:31.505104    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" path="/var/lib/kubelet/pods/0682ead6-a00a-435c-a924-63edeb83eaf4/volumes"
Jul 24 02:19:35.082933 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:35.082904    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:35.151611 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:35.151574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:35.252492 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:35.252459    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:38.190384 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:38.190344    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:19:39.939302 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:39.939264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:40.347829 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:40.347744    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:46.601876 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:46.601838    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:46.669408 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:46.669377    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:46.868102 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:46.868019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:47.123451 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:47.123365    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:51.161853 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:51.161814    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:57.625315 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:57.625283    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:57.780234 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:57.780169    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:19:57.842329 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:19:57.842288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:00.281161 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:00.281123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n4rng"]
Jul 24 02:20:02.316075 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:02.316019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:02.919917 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:02.919873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:08.526215 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:08.526167    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:08.638243 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:08.638197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:08.786566 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:08.786466    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"]
Jul 24 02:20:08.786770 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:08.786744    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" containerID="cri-o://4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941" gracePeriod=30
Jul 24 02:20:08.810547 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:08.810511    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:09.088066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:09.087982    2568 patch_prober.go:28] interesting pod/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 02:20:09.088066 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:09.088056    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 02:20:09.108597 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:09.108558    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:14.047514 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.047485    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:20:14.138668 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138579    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-data\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138668 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138631    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f9bfb0-622f-49c0-8912-afe094261c1e-istiod-ca-cert\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138668 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138665    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-token\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138690    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnqhw\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-kube-api-access-jnqhw\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138712    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-credential-socket\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138738    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-podinfo\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138840    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-certs\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138896    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-envoy\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.138967 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.138944    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-socket\") pod \"94f9bfb0-622f-49c0-8912-afe094261c1e\" (UID: \"94f9bfb0-622f-49c0-8912-afe094261c1e\") "
Jul 24 02:20:14.139322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139007    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:20:14.139322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139101    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f9bfb0-622f-49c0-8912-afe094261c1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 02:20:14.139322 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139205    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:20:14.139489 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139360    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:20:14.139489 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139448    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:20:14.139489 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139455    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.139652 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139496    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94f9bfb0-622f-49c0-8912-afe094261c1e-istiod-ca-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.139652 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139513    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-credential-socket\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.139652 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.139526    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-workload-certs\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.141031 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.141008    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 02:20:14.141161 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.141032    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-kube-api-access-jnqhw" (OuterVolumeSpecName: "kube-api-access-jnqhw") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "kube-api-access-jnqhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:20:14.141161 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.141050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 02:20:14.141161 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.141113    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94f9bfb0-622f-49c0-8912-afe094261c1e" (UID: "94f9bfb0-622f-49c0-8912-afe094261c1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 02:20:14.240328 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.240294    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.240328 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.240327    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnqhw\" (UniqueName: \"kubernetes.io/projected/94f9bfb0-622f-49c0-8912-afe094261c1e-kube-api-access-jnqhw\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.240540 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.240341    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-podinfo\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.240540 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.240354    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-envoy\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.240540 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.240363    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94f9bfb0-622f-49c0-8912-afe094261c1e-istio-data\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 24 02:20:14.410220 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.410114    2568 generic.go:356] "Generic (PLEG): container finished" podID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerID="4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941" exitCode=0
Jul 24 02:20:14.410220 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.410161    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"
Jul 24 02:20:14.410465 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.410222    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" event={"ID":"94f9bfb0-622f-49c0-8912-afe094261c1e","Type":"ContainerDied","Data":"4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941"}
Jul 24 02:20:14.410465 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.410289    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm" event={"ID":"94f9bfb0-622f-49c0-8912-afe094261c1e","Type":"ContainerDied","Data":"58189dc81b8c51180e6e0ece05758fcdd39f39a1ed0912056d10113738dea264"}
Jul 24 02:20:14.410465 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.410320    2568 scope.go:117] "RemoveContainer" containerID="4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941"
Jul 24 02:20:14.426791 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.426773    2568 scope.go:117] "RemoveContainer" containerID="01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"
Jul 24 02:20:14.434592 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.434553    2568 scope.go:117] "RemoveContainer" containerID="4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941"
Jul 24 02:20:14.434937 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:20:14.434908    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941\": container with ID starting with 4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941 not found: ID does not exist" containerID="4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941"
Jul 24 02:20:14.435047 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.434947    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941"} err="failed to get container status \"4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941\": rpc error: code = NotFound desc = could not find container \"4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941\": container with ID starting with 4bde62dfa17c5ecf72628f929c152497fa1a7906e4aa5c6d596fe4303d2cf941 not found: ID does not exist"
Jul 24 02:20:14.435047 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.434974    2568 scope.go:117] "RemoveContainer" containerID="01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"
Jul 24 02:20:14.435361 ip-10-0-142-39 kubenswrapper[2568]: E0724 02:20:14.435332    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795\": container with ID starting with 01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795 not found: ID does not exist" containerID="01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"
Jul 24 02:20:14.435472 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.435369    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795"} err="failed to get container status \"01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795\": rpc error: code = NotFound desc = could not find container \"01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795\": container with ID starting with 01d7be4dbe4389c783b0ee02c6f7bba3c0877593b039266964d541d8ce0ee795 not found: ID does not exist"
Jul 24 02:20:14.437294 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.437273    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"]
Jul 24 02:20:14.440483 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:14.440461    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a7fbc1-openshift-default-7c9855dcb4-snwzm"]
Jul 24 02:20:15.192934 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:15.192905    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-k577l_b213e83b-ff93-4261-a5a1-b3a1c5a482e7/manager/0.log"
Jul 24 02:20:15.504998 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:15.504916    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" path="/var/lib/kubelet/pods/94f9bfb0-622f-49c0-8912-afe094261c1e/volumes"
Jul 24 02:20:15.963056 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:15.963032    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59c5678768-7jzkv_a6fc4bfd-544b-4994-94f0-c91ab71d831a/copy-manifests/0.log"
Jul 24 02:20:15.975424 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:15.975400    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59c5678768-7jzkv_a6fc4bfd-544b-4994-94f0-c91ab71d831a/manager/0.log"
Jul 24 02:20:18.534101 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:18.534073    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pd758_2f25d127-9ab8-4aae-9679-a78c6a260204/manager/0.log"
Jul 24 02:20:18.775361 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:18.775335    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ngcgz_520a90c1-af5d-4221-bf33-80d5f8675817/registry-server/0.log"
Jul 24 02:20:18.905798 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:18.905720    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-95j5r_cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0/manager/0.log"
Jul 24 02:20:19.023544 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:19.023514    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n4rng_410f5229-7d74-4672-a29d-435ade25ab53/limitador/0.log"
Jul 24 02:20:19.143884 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:19.143858    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vz74f_6de0a039-69eb-4e42-aab8-8df8c4d4c63f/manager/0.log"
Jul 24 02:20:19.514651 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:19.514624    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chv56t_33678dd4-101f-4b6d-85ee-79243359d198/istio-proxy/0.log"
Jul 24 02:20:20.349557 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:20.349529    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbcd9ccc5-75cjt_0690d3c9-be0d-472a-a17a-7344fdfab5fa/router/0.log"
Jul 24 02:20:20.950434 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:20.950404    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kfpcz_04f0042a-48f8-4b23-ab38-d0d6da4a51fb/main/0.log"
Jul 24 02:20:26.970123 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970086    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m522w/must-gather-n5tx9"]
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970472    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970484    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970499    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970505    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970513    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970519    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970537    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970542    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970556    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy"
Jul 24 02:20:26.970555 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970561    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970570    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6be9ba2-2509-42af-b902-d5134b7d73c7" containerName="main"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970575    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6be9ba2-2509-42af-b902-d5134b7d73c7" containerName="main"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970623    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970631    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970636    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970642    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6be9ba2-2509-42af-b902-d5134b7d73c7" containerName="main"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970648    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f9bfb0-622f-49c0-8912-afe094261c1e" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970704    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970710    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970766    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd07cd13-c144-4c7b-a3de-56d53798afe1" containerName="istio-proxy"
Jul 24 02:20:26.970862 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.970776    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0682ead6-a00a-435c-a924-63edeb83eaf4" containerName="istio-proxy"
Jul 24 02:20:26.975270 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.975253    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:26.977901 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.977866    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m522w\"/\"kube-root-ca.crt\""
Jul 24 02:20:26.978853 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.978835    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m522w\"/\"default-dockercfg-5qkq6\""
Jul 24 02:20:26.978941 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.978856    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m522w\"/\"openshift-service-ca.crt\""
Jul 24 02:20:26.982954 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.982932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m522w/must-gather-n5tx9"]
Jul 24 02:20:26.986289 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:26.986265    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:27.054025 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.053988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwbd\" (UniqueName: \"kubernetes.io/projected/b6d4ae6c-e513-4512-87e3-0e52198422a3-kube-api-access-pfwbd\") pod \"must-gather-n5tx9\" (UID: \"b6d4ae6c-e513-4512-87e3-0e52198422a3\") " pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.054247 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.054044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6d4ae6c-e513-4512-87e3-0e52198422a3-must-gather-output\") pod \"must-gather-n5tx9\" (UID: \"b6d4ae6c-e513-4512-87e3-0e52198422a3\") " pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.054877 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.054852    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log" limit=1024
Jul 24 02:20:27.154793 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.154763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwbd\" (UniqueName: \"kubernetes.io/projected/b6d4ae6c-e513-4512-87e3-0e52198422a3-kube-api-access-pfwbd\") pod \"must-gather-n5tx9\" (UID: \"b6d4ae6c-e513-4512-87e3-0e52198422a3\") " pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.154935 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.154820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6d4ae6c-e513-4512-87e3-0e52198422a3-must-gather-output\") pod \"must-gather-n5tx9\" (UID: \"b6d4ae6c-e513-4512-87e3-0e52198422a3\") " pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.155232 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.155212    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6d4ae6c-e513-4512-87e3-0e52198422a3-must-gather-output\") pod \"must-gather-n5tx9\" (UID: \"b6d4ae6c-e513-4512-87e3-0e52198422a3\") " pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.162547 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.162517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwbd\" (UniqueName: \"kubernetes.io/projected/b6d4ae6c-e513-4512-87e3-0e52198422a3-kube-api-access-pfwbd\") pod \"must-gather-n5tx9\" (UID: \"b6d4ae6c-e513-4512-87e3-0e52198422a3\") " pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.304388 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.304296    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m522w/must-gather-n5tx9"
Jul 24 02:20:27.436364 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.436336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m522w/must-gather-n5tx9"]
Jul 24 02:20:27.438888 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:20:27.438830    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6d4ae6c_e513_4512_87e3_0e52198422a3.slice/crio-12e7589c248e7ea101f12336136e87a4c8002e059c47ea7819c10a86fa7f1e15 WatchSource:0}: Error finding container 12e7589c248e7ea101f12336136e87a4c8002e059c47ea7819c10a86fa7f1e15: Status 404 returned error can't find the container with id 12e7589c248e7ea101f12336136e87a4c8002e059c47ea7819c10a86fa7f1e15
Jul 24 02:20:27.442725 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.442710    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 02:20:27.473049 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:27.473012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m522w/must-gather-n5tx9" event={"ID":"b6d4ae6c-e513-4512-87e3-0e52198422a3","Type":"ContainerStarted","Data":"12e7589c248e7ea101f12336136e87a4c8002e059c47ea7819c10a86fa7f1e15"}
Jul 24 02:20:28.479485 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:28.479443    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m522w/must-gather-n5tx9" event={"ID":"b6d4ae6c-e513-4512-87e3-0e52198422a3","Type":"ContainerStarted","Data":"82dfed9b471e42accf9428e3d9bbcfd57bde2f7fe9a40c82c5ed65422441d576"}
Jul 24 02:20:28.479485 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:28.479486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m522w/must-gather-n5tx9" event={"ID":"b6d4ae6c-e513-4512-87e3-0e52198422a3","Type":"ContainerStarted","Data":"c4fff56a821e8b8866edc0ef272d0d7f9d4cfe2966f5fc505f2f6b9ab99e8a20"}
Jul 24 02:20:28.495107 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:28.495045    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m522w/must-gather-n5tx9" podStartSLOduration=1.759672752 podStartE2EDuration="2.495024344s" totalImagesPullingTime="735.351592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 02:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:20:28.494055017 +0000 UTC m=+3041.518453496" watchObservedRunningTime="2026-07-24 02:20:28.495024344 +0000 UTC m=+3041.519422823"
Jul 24 02:20:29.790316 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:29.790283    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h2n47_428c7226-3595-46d2-b65f-88b56844aa07/global-pull-secret-syncer/0.log"
Jul 24 02:20:29.886065 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:29.886036    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-49pmx_039c784d-6e15-4c07-b74b-00f8de82fae0/konnectivity-agent/0.log"
Jul 24 02:20:30.022376 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:30.022339    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-39.ec2.internal_4f5849b1db054671471ad846da70fb01/haproxy/0.log"
Jul 24 02:20:34.605787 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:34.605756    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pd758_2f25d127-9ab8-4aae-9679-a78c6a260204/manager/0.log"
Jul 24 02:20:34.682458 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:34.682422    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ngcgz_520a90c1-af5d-4221-bf33-80d5f8675817/registry-server/0.log"
Jul 24 02:20:34.893385 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:34.893303    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-95j5r_cee2bc06-83f6-41f6-a6dc-ca9d8dacc2c0/manager/0.log"
Jul 24 02:20:34.915518 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:34.915489    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n4rng_410f5229-7d74-4672-a29d-435ade25ab53/limitador/0.log"
Jul 24 02:20:35.008198 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:35.007619    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vz74f_6de0a039-69eb-4e42-aab8-8df8c4d4c63f/manager/0.log"
Jul 24 02:20:36.714668 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.714641    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/alertmanager/0.log"
Jul 24 02:20:36.739979 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.739952    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/config-reloader/0.log"
Jul 24 02:20:36.761061 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.761008    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/kube-rbac-proxy-web/0.log"
Jul 24 02:20:36.782392 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.782347    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/kube-rbac-proxy/0.log"
Jul 24 02:20:36.806516 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.806459    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/kube-rbac-proxy-metric/0.log"
Jul 24 02:20:36.831598 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.831566    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/prom-label-proxy/0.log"
Jul 24 02:20:36.853888 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.853850    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70f510e0-bd1f-4e9f-8dde-0b055573b466/init-config-reloader/0.log"
Jul 24 02:20:36.914090 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:36.914059    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-mh6j2_9b58c51c-66eb-4646-8a6b-3bf4e5ac91c0/cluster-monitoring-operator/0.log"
Jul 24 02:20:37.070738 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.070608    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-czxqk_e4d0635f-e555-40b9-826a-42b1f8a71cd7/monitoring-plugin/0.log"
Jul 24 02:20:37.294312 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.294284    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t87w7_d8fa1c32-1b78-4779-a425-37e1cb4ca733/node-exporter/0.log"
Jul 24 02:20:37.327755 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.327672    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t87w7_d8fa1c32-1b78-4779-a425-37e1cb4ca733/kube-rbac-proxy/0.log"
Jul 24 02:20:37.360933 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.360908    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t87w7_d8fa1c32-1b78-4779-a425-37e1cb4ca733/init-textfile/0.log"
Jul 24 02:20:37.399142 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.399115    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-pzlv7_be635144-a290-46bf-978a-5709a17da12a/kube-rbac-proxy-main/0.log"
Jul 24 02:20:37.424628 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.424582    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-pzlv7_be635144-a290-46bf-978a-5709a17da12a/kube-rbac-proxy-self/0.log"
Jul 24 02:20:37.448774 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.448737    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-pzlv7_be635144-a290-46bf-978a-5709a17da12a/openshift-state-metrics/0.log"
Jul 24 02:20:37.493936 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.493887    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/prometheus/0.log"
Jul 24 02:20:37.517468 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.517416    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/config-reloader/0.log"
Jul 24 02:20:37.541286 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.541251    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/thanos-sidecar/0.log"
Jul 24 02:20:37.565138 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.565074    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/kube-rbac-proxy-web/0.log"
Jul 24 02:20:37.588058 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.587895    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/kube-rbac-proxy/0.log"
Jul 24 02:20:37.610936 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.610910    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/kube-rbac-proxy-thanos/0.log"
Jul 24 02:20:37.633627 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.633601    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bc330080-74bc-40b6-a33e-50e06fb000c3/init-config-reloader/0.log"
Jul 24 02:20:37.675752 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.675723    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-kxlxn_ae468737-6c3a-4e5c-86e5-bffb3b9c6288/prometheus-operator/0.log"
Jul 24 02:20:37.695656 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:37.695558    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-kxlxn_ae468737-6c3a-4e5c-86e5-bffb3b9c6288/kube-rbac-proxy/0.log"
Jul 24 02:20:40.389413 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.389327    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc6695b48-rqndt_335890ea-020e-421d-88ff-ba6102a0168f/console/0.log"
Jul 24 02:20:40.450047 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.450009    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-vd9fr_f80dd9d7-7bda-42f7-9145-7655e00c586f/download-server/0.log"
Jul 24 02:20:40.502026 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.501988    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"]
Jul 24 02:20:40.506315 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.506292    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.517285 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.517251    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"]
Jul 24 02:20:40.617282 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.617234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-proc\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.617476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.617416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-lib-modules\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.617476 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.617463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-podres\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.617577 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.617535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtnp6\" (UniqueName: \"kubernetes.io/projected/80fae260-2848-4326-90ea-b4cfdbf08602-kube-api-access-vtnp6\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.617631 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.617581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-sys\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.718814 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.718772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-sys\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.718829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-proc\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.718907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-sys\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.718932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-lib-modules\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.718950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-proc\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719018 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.718989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-podres\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719309 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.719048    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtnp6\" (UniqueName: \"kubernetes.io/projected/80fae260-2848-4326-90ea-b4cfdbf08602-kube-api-access-vtnp6\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719309 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.719061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-lib-modules\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.719309 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.719136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80fae260-2848-4326-90ea-b4cfdbf08602-podres\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.726855 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.726822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtnp6\" (UniqueName: \"kubernetes.io/projected/80fae260-2848-4326-90ea-b4cfdbf08602-kube-api-access-vtnp6\") pod \"perf-node-gather-daemonset-5ngtw\" (UID: \"80fae260-2848-4326-90ea-b4cfdbf08602\") " pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:40.823604 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:40.823563    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:41.007482 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:41.006675    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"]
Jul 24 02:20:41.010977 ip-10-0-142-39 kubenswrapper[2568]: W0724 02:20:41.010951    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod80fae260_2848_4326_90ea_b4cfdbf08602.slice/crio-cd033fb36b2cd4a255a3c2be31a3779a4d82f39f0ad89aa1625691a1b269e995 WatchSource:0}: Error finding container cd033fb36b2cd4a255a3c2be31a3779a4d82f39f0ad89aa1625691a1b269e995: Status 404 returned error can't find the container with id cd033fb36b2cd4a255a3c2be31a3779a4d82f39f0ad89aa1625691a1b269e995
Jul 24 02:20:41.582975 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:41.582941    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw" event={"ID":"80fae260-2848-4326-90ea-b4cfdbf08602","Type":"ContainerStarted","Data":"b230f14ff53bc7a53e1fe181e5527817906be2a6439d2515abcd3dc5d4b267ff"}
Jul 24 02:20:41.583413 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:41.582998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw" event={"ID":"80fae260-2848-4326-90ea-b4cfdbf08602","Type":"ContainerStarted","Data":"cd033fb36b2cd4a255a3c2be31a3779a4d82f39f0ad89aa1625691a1b269e995"}
Jul 24 02:20:41.583413 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:41.583084    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:41.601212 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:41.601128    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw" podStartSLOduration=1.601106025 podStartE2EDuration="1.601106025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 02:20:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 02:20:41.59929544 +0000 UTC m=+3054.623693917" watchObservedRunningTime="2026-07-24 02:20:41.601106025 +0000 UTC m=+3054.625504502"
Jul 24 02:20:42.268076 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:42.268042    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zfqjs_1f5c33ef-bd68-46ed-a7f0-018ce8d680ba/dns/0.log"
Jul 24 02:20:42.289201 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:42.289141    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zfqjs_1f5c33ef-bd68-46ed-a7f0-018ce8d680ba/kube-rbac-proxy/0.log"
Jul 24 02:20:42.356031 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:42.356005    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvrxj_d1908820-260b-4a3a-87b6-7aaff7be860c/dns-node-resolver/0.log"
Jul 24 02:20:42.878507 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:42.878469    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c6c967c67-6zgj9_2a4eb457-a2e7-4391-84cc-943313cb240d/registry/0.log"
Jul 24 02:20:42.929209 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:42.929165    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4k6tm_a23066aa-0fd2-4fef-96e5-8c71348c2999/node-ca/0.log"
Jul 24 02:20:43.873854 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:43.873801    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chv56t_33678dd4-101f-4b6d-85ee-79243359d198/istio-proxy/0.log"
Jul 24 02:20:44.211550 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:44.211522    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbcd9ccc5-75cjt_0690d3c9-be0d-472a-a17a-7344fdfab5fa/router/0.log"
Jul 24 02:20:44.979644 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:44.979610    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g8htf_086f90e8-d9f1-4ddc-9576-11ba7d48dfe7/serve-healthcheck-canary/0.log"
Jul 24 02:20:45.592461 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:45.592432    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2krt_be0aeed2-b8f1-4ac1-9a3b-acf786c0d792/kube-rbac-proxy/0.log"
Jul 24 02:20:45.613585 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:45.613556    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2krt_be0aeed2-b8f1-4ac1-9a3b-acf786c0d792/exporter/0.log"
Jul 24 02:20:45.636635 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:45.636610    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2krt_be0aeed2-b8f1-4ac1-9a3b-acf786c0d792/extractor/0.log"
Jul 24 02:20:47.600283 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:47.600256    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m522w/perf-node-gather-daemonset-5ngtw"
Jul 24 02:20:47.845557 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:47.845529    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-k577l_b213e83b-ff93-4261-a5a1-b3a1c5a482e7/manager/0.log"
Jul 24 02:20:48.520202 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:48.518026    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59c5678768-7jzkv_a6fc4bfd-544b-4994-94f0-c91ab71d831a/manager/0.log"
Jul 24 02:20:48.537240 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:48.537215    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59c5678768-7jzkv_a6fc4bfd-544b-4994-94f0-c91ab71d831a/copy-manifests/0.log"
Jul 24 02:20:49.969484 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:49.969450    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-745f9c9fb8-gl82x_44060b5b-12c7-425e-af2c-8a8cfe9bba43/manager/0.log"
Jul 24 02:20:50.659457 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:50.659371    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chv56t_33678dd4-101f-4b6d-85ee-79243359d198/istio-proxy/0.log"
Jul 24 02:20:50.928263 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:50.928165    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbcd9ccc5-75cjt_0690d3c9-be0d-472a-a17a-7344fdfab5fa/router/0.log"
Jul 24 02:20:52.286506 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:52.286468    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chv56t_33678dd4-101f-4b6d-85ee-79243359d198/istio-proxy/0.log"
Jul 24 02:20:52.567647 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:52.567612    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbcd9ccc5-75cjt_0690d3c9-be0d-472a-a17a-7344fdfab5fa/router/0.log"
Jul 24 02:20:56.509070 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.509034    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/kube-multus-additional-cni-plugins/0.log"
Jul 24 02:20:56.530008 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.529984    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/egress-router-binary-copy/0.log"
Jul 24 02:20:56.549836 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.549812    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/cni-plugins/0.log"
Jul 24 02:20:56.569740 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.569712    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/bond-cni-plugin/0.log"
Jul 24 02:20:56.588873 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.588849    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/routeoverride-cni/0.log"
Jul 24 02:20:56.608815 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.608791    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/whereabouts-cni-bincopy/0.log"
Jul 24 02:20:56.629118 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.629090    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28zrg_e7771e29-58a0-4ab6-b60a-635763575225/whereabouts-cni/0.log"
Jul 24 02:20:56.965294 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:56.965222    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j6w46_4590664c-1db4-4aca-91b9-2c4b5e81d845/kube-multus/0.log"
Jul 24 02:20:57.144165 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:57.144116    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qj6hm_ee465a91-7a71-4825-b9af-38457c725db6/network-metrics-daemon/0.log"
Jul 24 02:20:57.160776 ip-10-0-142-39 kubenswrapper[2568]: I0724 02:20:57.160747    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qj6hm_ee465a91-7a71-4825-b9af-38457c725db6/kube-rbac-proxy/0.log"