Jul 21 16:26:09.358652 ip-10-0-129-98 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 16:26:09.358669 ip-10-0-129-98 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 16:26:09.358679 ip-10-0-129-98 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 16:26:09.359053 ip-10-0-129-98 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 16:26:20.921353 ip-10-0-129-98 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 16:26:20.921371 ip-10-0-129-98 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1e7daab754494f2a9f3b96884c9004a6 --
Jul 21 16:27:57.594522 ip-10-0-129-98 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 16:27:58.048620 ip-10-0-129-98 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:27:58.048620 ip-10-0-129-98 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 16:27:58.048620 ip-10-0-129-98 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:27:58.048620 ip-10-0-129-98 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 16:27:58.048620 ip-10-0-129-98 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:27:58.050192 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.050039    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 16:27:58.057310 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057278    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:27:58.057310 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057307    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:27:58.057310 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057311    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:27:58.057310 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057314    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057320    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057325    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057328    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057330    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057333    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057337    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057340    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057343    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057346    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057349    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057351    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057354    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057357    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057360    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057362    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057365    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057367    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057370    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057374    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:27:58.057455 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057378    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057382    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057385    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057387    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057390    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057393    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057395    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057398    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057401    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057403    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057406    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057409    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057411    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057416    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057420    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057423    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057426    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057430    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057434    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:27:58.057935 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057437    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057441    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057444    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057448    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057451    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057453    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057456    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057459    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057462    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057465    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057468    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057470    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057473    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057477    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057479    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057482    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057484    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057487    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057489    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057492    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:27:58.058433 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057494    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057497    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057501    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057503    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057506    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057509    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057511    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057514    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057518    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057522    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057524    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057527    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057529    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057532    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057534    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057536    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057539    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057541    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057544    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:27:58.058922 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057546    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057548    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057551    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057554    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057556    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057559    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057561    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057564    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057566    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057569    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057571    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057573    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057576    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057579    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057581    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057583    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057586    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.057588    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058401    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058409    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:27:58.059412 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058413    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058416    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058418    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058421    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058425    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058428    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058431    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058433    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058436    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058439    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058441    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058444    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058447    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058450    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058452    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058455    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058457    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058460    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058465    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:27:58.059950 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058469    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058472    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058475    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058478    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058480    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058482    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058485    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058488    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058490    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058493    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058495    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058497    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058500    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058504    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058507    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058509    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058512    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058523    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058529    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:27:58.060467 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058532    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058535    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058537    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058540    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058542    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058545    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058548    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058551    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058553    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058556    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058558    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058561    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058563    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058566    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058569    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058571    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058573    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058576    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058578    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058585    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:27:58.060939 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058587    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058590    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058593    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058595    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058598    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058600    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058603    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058606    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058608    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058611    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058613    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058619    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058622    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058625    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058627    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058631    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058633    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058635    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058638    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058641    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:27:58.061450 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058643    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058646    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058649    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058653    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058656    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058658    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058661    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058664    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058666    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058669    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058671    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058675    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058677    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058680    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058683    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058685    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058688    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058690    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.058693    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:27:58.061969 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059223    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059231    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059234    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059238    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059241    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059244    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059247    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059250    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059252    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059257    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059260    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059263    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059266    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059269    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059271    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059274    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059276    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059279    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059281    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:27:58.062458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059284    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059286    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059289    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059291    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059294    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059298    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059301    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059304    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059306    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059309    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059311    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059314    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059317    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059319    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059322    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059324    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059327    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059329    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059332    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059335    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:27:58.062925 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059337    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059340    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059342    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059344    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059347    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059349    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059352    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059355    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059357    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059360    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059362    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059365    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059367    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059370    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059373    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059376    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059378    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059383    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059386    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059388    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:27:58.063547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059392    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059396    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059400    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059404    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059410    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059413    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059416    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059420    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059423    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059425    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059428    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059431    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059434    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059437    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059439    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059441    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059445    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059447    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059449    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059451    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:27:58.064049 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059454    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059456    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059459    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059461    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059464    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059466    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059468    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059471    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059473    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059476    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059479    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059481    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059484    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059486    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059489    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059491    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059494    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059497    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059499    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.059502    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059577    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 16:27:58.064605 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059585    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059591    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059596    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059601    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059604    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059608    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059613    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059616    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059619    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059622    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059625    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059628    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059631    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059634    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059637    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059640    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059643    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059647    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059650    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059653    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059657    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059660    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059664    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 16:27:58.065148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059667    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059670    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059673    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059676    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059679    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059683    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059686    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059689    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059694    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059697    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059699    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059702    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059705    2575 flags.go:64] FLAG: --enable-server="true"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059709    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059713    2575 flags.go:64] FLAG: --event-burst="100"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059717    2575 flags.go:64] FLAG: --event-qps="50"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059719    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059722    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059725    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059729    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059732    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059735    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059738    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059741    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059743    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 16:27:58.065726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059747    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059749    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059752    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059756    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059759    2575 flags.go:64] FLAG: --feature-gates=""
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059762    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059765    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059768    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059771    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059774    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059777    2575 flags.go:64] FLAG: --help="false"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059780    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059783    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059786    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059789    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059792    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059796    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059799    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059803    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059806    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059809    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059812    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059816    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059819    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 21 16:27:58.066359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059821    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059824    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059827    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059830    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059833    2575 flags.go:64] FLAG: --lock-file=""
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059835    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059838    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059841    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059847    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059850    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059853    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059856    2575 flags.go:64] FLAG: --logging-format="text"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059859    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059862    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059865    2575 flags.go:64] FLAG: --manifest-url=""
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059868    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059872    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059875    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059879    2575 flags.go:64] FLAG: --max-pods="110"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059882    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059885    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059888    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059891    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059895    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059897    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 16:27:58.066960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059900    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059908    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059911    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059914    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059917    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059921    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059927    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059930    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059943    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059947    2575 flags.go:64] FLAG: --port="10250"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059949    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059952    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f454397cf49e7d07"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059955    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059959    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059961    2575 flags.go:64] FLAG: --register-node="true"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059964    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059968    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059971    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059977    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059979    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059983    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059986    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059989    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059992    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059995    2575 flags.go:64] FLAG: --runonce="false"
Jul 21 16:27:58.067623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.059998    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060001    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060004    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060007    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060009    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060012    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060015    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060018    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060021    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060024    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060027    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060029    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060032    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060036    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060039    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060044    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060047    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060050    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060054    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060057    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060060    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060062    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060065    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060068    2575 flags.go:64] FLAG: --v="2"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060072    2575 flags.go:64] FLAG: --version="false"
Jul 21 16:27:58.068274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060080    2575 flags.go:64] FLAG: --vmodule=""
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060083    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.060087    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060233    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060238    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060241    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060243    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060246    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060248    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060251    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060253    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060256    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060258    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060261    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060263    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060266    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060268    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060271    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060273    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060276    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:27:58.068929 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060278    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060283    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060285    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060288    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060291    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060293    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060296    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060298    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060301    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060304    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060307    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060309    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060342    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060363    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060368    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060371    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060374    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060376    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060379    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060385    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:27:58.069458 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060388    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060391    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060393    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060398    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060402    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060405    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060408    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060411    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060414    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060417    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060420    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060423    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060426    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060428    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060431    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060434    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060437    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060440    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060442    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:27:58.069961 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060445    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060447    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060450    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060453    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060455    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060459    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060469    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060472    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060476    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060478    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060483    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060485    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060488    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060491    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060494    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060497    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060500    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060503    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060507    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:27:58.070453 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060511    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060514    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060517    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060520    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060523    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060525    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060528    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060531    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060533    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060536    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060538    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060541    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060544    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060547    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060549    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060552    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060554    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060580    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060586    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060590    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:27:58.070907 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060595    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060599    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060601    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.060604    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.061496    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.068628    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.068648    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.069453    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.069461    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069525    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069532    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069535    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069539    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069542    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069545    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:27:58.071423 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069548    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069550    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069553    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069556    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069558    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069561    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069564    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069567    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069569    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069572    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069575    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069577    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069581    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069583    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069586    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069589    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069591    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069594    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069598    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:27:58.071810 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069601    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069604    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069606    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069609    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069613    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069616    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069618    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069621    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069623    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069626    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069628    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069631    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069634    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069637    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069639    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069641    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069644    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069647    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069649    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069651    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:27:58.072358 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069654    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069656    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069660    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069662    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069664    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069667    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069670    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069673    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069675    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069678    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069680    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069682    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069685    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069687    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069690    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069693    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069696    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069698    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069701    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069704    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:27:58.073127 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069706    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069709    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069712    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069717    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069720    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069723    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069725    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069728    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069731    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069733    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069737    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069740    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069743    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069746    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069749    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069751    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069754    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069756    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069758    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:27:58.073730 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069761    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069764    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069766    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069769    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069771    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069774    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069776    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069778    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069781    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069784    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069788    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069790    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069793    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069795    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:27:58.074299 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069798    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.069803    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069921    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069927    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069930    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069932    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069935    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069939    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069942    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069946    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069949    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069952    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069954    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069956    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069959    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:27:58.074687 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069961    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069964    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069967    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069969    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069972    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069975    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069978    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069981    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069983    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069986    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069988    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069990    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069993    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069995    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.069998    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070001    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070003    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070005    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070008    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:27:58.075069 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070010    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070012    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070015    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070017    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070020    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070022    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070024    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070027    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070029    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070031    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070034    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070036    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070040    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070043    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070046    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070050    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070052    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070054    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070058    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:27:58.075577 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070060    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070063    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070065    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070068    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070071    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070074    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070076    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070079    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070082    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070084    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070087    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070089    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070091    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070094    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070096    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070098    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070101    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070104    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070106    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070108    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:27:58.076061 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070111    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070113    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070116    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070118    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070120    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070123    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070125    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070128    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070130    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070133    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070139    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070142    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070145    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070148    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070150    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070152    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070155    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070157    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070160    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070175    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:27:58.076576 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070178    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070180    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070183    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070186    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070188    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070191    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070193    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:58.070196    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.070202    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.070338    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.073795    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.075345    2575 server.go:1019] "Starting client certificate rotation"
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.075451    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:27:58.077066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.075484    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:27:58.077877 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.077862    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:27:58.081364 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.081349    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:27:58.091592 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.091568    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 21 16:27:58.093704 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.093682    2575 log.go:25] "Validated CRI v1 image API"
Jul 21 16:27:58.095457 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.095440    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 16:27:58.098748 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.098726    2575 fs.go:135] Filesystem UUIDs: map[3083fb07-228c-4f92-9379-3c95f677301b:/dev/nvme0n1p3 73a00709-33ea-42c6-baeb-45e8776a93e7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 21 16:27:58.098822 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.098747    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 16:27:58.103473 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.103451    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:27:58.103926 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.103814    2575 manager.go:216] Machine: {Timestamp:2026-07-21 16:27:58.102516045 +0000 UTC m=+0.370508711 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103077 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec227263db7c7c8d734695f8d8ddb741 SystemUUID:ec227263-db7c-7c8d-7346-95f8d8ddb741 BootID:1e7daab7-5449-4f2a-9f3b-96884c9004a6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:39:f3:9b:25:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:39:f3:9b:25:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:0f:44:71:30:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 16:27:58.103926 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.103923    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 16:27:58.104042 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.104026    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 16:27:58.107577 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.107550    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 16:27:58.107732 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.107579    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 16:27:58.108290 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.108280    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 16:27:58.108332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.108293    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 16:27:58.108332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.108300    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:27:58.108886 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.108876    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:27:58.110114 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.110104    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 16:27:58.113262 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113250    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:27:58.113403 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113393    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 16:27:58.113433 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113424    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 16:27:58.113502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113436    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 16:27:58.113502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113449    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 16:27:58.113502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113461    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 21 16:27:58.113502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113470    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 16:27:58.113949 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113937    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:27:58.114002 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.113964    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:27:58.116944 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.116911    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 16:27:58.118429 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.118413    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 16:27:58.118511 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.118445    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 16:27:58.119075 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119063    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 16:27:58.119124 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119080    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 16:27:58.119124 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119087    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 16:27:58.119124 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119093    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 16:27:58.119124 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119101    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 16:27:58.119124 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119106    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 16:27:58.119292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119153    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 16:27:58.119292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119159    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 16:27:58.119292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119183    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 16:27:58.119292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119189    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 16:27:58.119292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119198    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 16:27:58.119292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119205    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 16:27:58.119978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119968    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 16:27:58.119978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.119978    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 16:27:58.123250 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.123234    2575 server.go:1268] "Started kubelet"
Jul 21 16:27:58.123404 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.123329    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 16:27:58.123451 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.123430    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 16:27:58.123522 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.123499    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 16:27:58.124196 ip-10-0-129-98 systemd[1]: Started Kubernetes Kubelet.
Jul 21 16:27:58.124547 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.124528    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 16:27:58.124923 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.124890    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 16:27:58.125502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.125484    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 16:27:58.125599 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.125561    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 16:27:58.125599 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.125565    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 16:27:58.131318 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.131295    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 16:27:58.132156 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132136    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 16:27:58.132156 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132149    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 16:27:58.132324 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.132220    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.132775 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.131577    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-98.ec2.internal.18c45ae1c87b056b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-98.ec2.internal,UID:ip-10-0-129-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-98.ec2.internal,},FirstTimestamp:2026-07-21 16:27:58.123205995 +0000 UTC m=+0.391198659,LastTimestamp:2026-07-21 16:27:58.123205995 +0000 UTC m=+0.391198659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-98.ec2.internal,}"
Jul 21 16:27:58.132898 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132807    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 16:27:58.132898 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132825    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 16:27:58.132977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132930    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 16:27:58.132977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132940    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 16:27:58.132977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132960    2575 factory.go:55] Registering systemd factory
Jul 21 16:27:58.132977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132975    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 21 16:27:58.133181 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.132962    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 16:27:58.133251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.133239    2575 factory.go:153] Registering CRI-O factory
Jul 21 16:27:58.133301 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.133257    2575 factory.go:223] Registration of the crio container factory successfully
Jul 21 16:27:58.133336 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.133329    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 16:27:58.133368 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.133358    2575 factory.go:103] Registering Raw factory
Jul 21 16:27:58.133842 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.133825    2575 manager.go:1196] Started watching for new ooms in manager
Jul 21 16:27:58.134289 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.134273    2575 manager.go:349] Starting recovery of all containers
Jul 21 16:27:58.136503 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.136474    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 16:27:58.136612 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.136579    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 16:27:58.145116 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.145095    2575 manager.go:354] Recovery completed
Jul 21 16:27:58.146833 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.146813    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 21 16:27:58.149910 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.149896    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.151982 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.151965    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.152050 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.152004    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.152050 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.152018    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.152571 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.152558    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 16:27:58.152618 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.152572    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 16:27:58.152618 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.152578    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.152618 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.152587    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:27:58.153294 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.153278    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.153340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.153309    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.153340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.153319    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.153873 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.153859    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kcrj"
Jul 21 16:27:58.154150 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.154137    2575 policy_none.go:49] "None policy: Start"
Jul 21 16:27:58.154262 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.154159    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 16:27:58.154262 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.154189    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 16:27:58.154387 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.154294    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-98.ec2.internal.18c45ae1ca322466  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-98.ec2.internal,UID:ip-10-0-129-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-98.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-98.ec2.internal,},FirstTimestamp:2026-07-21 16:27:58.15198423 +0000 UTC m=+0.419976903,LastTimestamp:2026-07-21 16:27:58.15198423 +0000 UTC m=+0.419976903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-98.ec2.internal,}"
Jul 21 16:27:58.155193 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.155180    2575 policy_none.go:47] "Start"
Jul 21 16:27:58.162035 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.162017    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kcrj"
Jul 21 16:27:58.163744 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.163665    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-98.ec2.internal.18c45ae1ca328de2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-98.ec2.internal,UID:ip-10-0-129-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-98.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-98.ec2.internal,},FirstTimestamp:2026-07-21 16:27:58.152011234 +0000 UTC m=+0.420003898,LastTimestamp:2026-07-21 16:27:58.152011234 +0000 UTC m=+0.420003898,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-98.ec2.internal,}"
Jul 21 16:27:58.192027 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.191820    2575 manager.go:337] "Starting Device Plugin manager"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.192070    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.192085    2575 server.go:87] "Starting device plugin registration server"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.192383    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.192396    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.192498    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.192580    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.192587    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.193144    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 16:27:58.207727 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.193208    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.237078 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.237039    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 16:27:58.238429 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.238407    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 16:27:58.238566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.238454    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 16:27:58.238566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.238483    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 16:27:58.238566 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.238525    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 16:27:58.240707 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.240686    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:27:58.292894 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.292853    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.293829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.293810    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.293908 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.293846    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.293908 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.293861    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.293908 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.293886    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.304485 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.304412    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.304485 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.304443    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-98.ec2.internal\": node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.327468 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.327435    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.338922 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.338887    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"]
Jul 21 16:27:58.339065 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.338966    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.340007 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.339992    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.340070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.340031    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.340070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.340045    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.341443 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.341430    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.341564 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.341546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.341670 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.341582    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.342252 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.342233    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.342344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.342271    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.342344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.342282    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.342344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.342235    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.342344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.342336    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.342478 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.342349    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.343571 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.343557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.343613 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.343583    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:58.344272 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.344254    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:58.344344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.344296    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:58.344344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.344310    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:58.357778 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.357755    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-98.ec2.internal\" not found" node="ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.362068 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.362053    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-98.ec2.internal\" not found" node="ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.428485 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.428456    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.434714 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.434693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1e91e225a0145e17a81d6cda6c1fe8a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-98.ec2.internal\" (UID: \"a1e91e225a0145e17a81d6cda6c1fe8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.434773 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.434719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d999f00e0a39ba2e8ae365bc665ef639-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal\" (UID: \"d999f00e0a39ba2e8ae365bc665ef639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.434773 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.434735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d999f00e0a39ba2e8ae365bc665ef639-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal\" (UID: \"d999f00e0a39ba2e8ae365bc665ef639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.529608 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.529566    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.534950 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.534927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d999f00e0a39ba2e8ae365bc665ef639-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal\" (UID: \"d999f00e0a39ba2e8ae365bc665ef639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.535013 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.534958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d999f00e0a39ba2e8ae365bc665ef639-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal\" (UID: \"d999f00e0a39ba2e8ae365bc665ef639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.535013 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.534975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1e91e225a0145e17a81d6cda6c1fe8a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-98.ec2.internal\" (UID: \"a1e91e225a0145e17a81d6cda6c1fe8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.535073 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.535023    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1e91e225a0145e17a81d6cda6c1fe8a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-98.ec2.internal\" (UID: \"a1e91e225a0145e17a81d6cda6c1fe8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.535073 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.535029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d999f00e0a39ba2e8ae365bc665ef639-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal\" (UID: \"d999f00e0a39ba2e8ae365bc665ef639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.535073 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.535039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d999f00e0a39ba2e8ae365bc665ef639-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal\" (UID: \"d999f00e0a39ba2e8ae365bc665ef639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.630496 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.630412    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.660998 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.660966    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.665927 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.665908    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:58.730922 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.730887    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.831491 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.831451    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.932083 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:58.932005    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:58.948428 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:58.948398    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:27:59.032901 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:59.032867    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:59.074361 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.074330    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 16:27:59.074798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.074508    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:27:59.074798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.074531    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:27:59.133456 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:59.133424    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:59.166922 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.166859    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:22:58 +0000 UTC" deadline="2028-03-22 17:52:53.537108428 +0000 UTC"
Jul 21 16:27:59.166922 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.166912    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14641h24m54.370200015s"
Jul 21 16:27:59.234366 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:59.234329    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:59.293072 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:59.293017    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd999f00e0a39ba2e8ae365bc665ef639.slice/crio-0b267adb76945a7f2e4fce79f4e51f9a18a3ff96a43bdbf52463b81a42e4881c WatchSource:0}: Error finding container 0b267adb76945a7f2e4fce79f4e51f9a18a3ff96a43bdbf52463b81a42e4881c: Status 404 returned error can't find the container with id 0b267adb76945a7f2e4fce79f4e51f9a18a3ff96a43bdbf52463b81a42e4881c
Jul 21 16:27:59.293440 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:27:59.293413    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e91e225a0145e17a81d6cda6c1fe8a.slice/crio-eb9e75e71b44bce8690a96392fd21f3306767f7084c1b9f650a410ea211a19b6 WatchSource:0}: Error finding container eb9e75e71b44bce8690a96392fd21f3306767f7084c1b9f650a410ea211a19b6: Status 404 returned error can't find the container with id eb9e75e71b44bce8690a96392fd21f3306767f7084c1b9f650a410ea211a19b6
Jul 21 16:27:59.299883 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.299861    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:27:59.334905 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:27:59.334870    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-98.ec2.internal\" not found"
Jul 21 16:27:59.345413 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.345389    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:27:59.354549 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.354520    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:27:59.355723 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.355705    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:27:59.355820 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.355736    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:27:59.355820 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.355745    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:27:59.362844 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.362823    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:27:59.432665 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.432627    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:59.444598 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.444572    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:27:59.445620 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.445604    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal"
Jul 21 16:27:59.453545 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:27:59.453495    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:28:00.115493 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.115454    2575 apiserver.go:52] "Watching apiserver"
Jul 21 16:28:00.123068 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.123030    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 16:28:00.124559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.124524    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-w5xzg","openshift-multus/multus-additional-cni-plugins-4fhjx","openshift-multus/network-metrics-daemon-wnthg","openshift-network-diagnostics/network-check-target-jfhlt","openshift-ovn-kubernetes/ovnkube-node-dfnjx","kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal","openshift-dns/node-resolver-7t5gx","openshift-image-registry/node-ca-m6nn9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal","openshift-multus/multus-pk7sq","openshift-network-operator/iptables-alerter-r5mt4","kube-system/global-pull-secret-syncer-5vdds","kube-system/konnectivity-agent-9m6mx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"]
Jul 21 16:28:00.126324 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.126299    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.128783 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.128757    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.129043 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.129011    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.129287 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.129266    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cw8lp\""
Jul 21 16:28:00.133082 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.133059    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.133829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.133785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.133957 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.133886    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:00.134111 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.134066    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 16:28:00.134293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.134267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:00.134366 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.134332    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:00.135862 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.135838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.136945 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.136923    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 16:28:00.137112 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.137088    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g7lmg\""
Jul 21 16:28:00.137466 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.137446    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.137597 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.137578    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:00.137945 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.137926    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 16:28:00.138581 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.138562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.140690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.139933    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141299    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141430    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141457    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mt5b4\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141514    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141599    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141731    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141782    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141840    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.141848    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142011    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xhw4\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142041    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142101    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 16:28:00.142157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4w67h\""
Jul 21 16:28:00.142823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142339    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.142823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5sgcc\""
Jul 21 16:28:00.142823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142470    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 16:28:00.142823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142507    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.142823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.142517    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.143416 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.143399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.143923 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.143902    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 16:28:00.145875 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.145854    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-86c6v\""
Jul 21 16:28:00.146154 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.146135    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 16:28:00.146445 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.146427    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.146656 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.146637    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 16:28:00.147113 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.147093    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.147331 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.147312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 16:28:00.148361 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.148334    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s77hd\""
Jul 21 16:28:00.150040 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.150108    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9caf168e-ecbf-41a3-a16e-eefd37999650-agent-certs\") pod \"konnectivity-agent-9m6mx\" (UID: \"9caf168e-ecbf-41a3-a16e-eefd37999650\") " pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9caf168e-ecbf-41a3-a16e-eefd37999650-konnectivity-ca\") pod \"konnectivity-agent-9m6mx\" (UID: \"9caf168e-ecbf-41a3-a16e-eefd37999650\") " pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrd7l\" (UniqueName: \"kubernetes.io/projected/00314b86-e6f3-4785-9870-ace7beeb1caa-kube-api-access-zrd7l\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.151360 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.150450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-tmp-dir\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.151768 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.151745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.151825 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.151796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-hosts-file\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.151904 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.151852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkn2n\" (UniqueName: \"kubernetes.io/projected/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-kube-api-access-gkn2n\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.151964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.151912    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:28:00.153649 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.153376    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:00.153649 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.153580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nnjjm\""
Jul 21 16:28:00.153805 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.153732    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 16:28:00.153904 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.153885    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:00.169998 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.169940    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dnwjw"
Jul 21 16:28:00.175670 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.175642    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dnwjw"
Jul 21 16:28:00.233864 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.233828    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 16:28:00.243712 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.243646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal" event={"ID":"a1e91e225a0145e17a81d6cda6c1fe8a","Type":"ContainerStarted","Data":"eb9e75e71b44bce8690a96392fd21f3306767f7084c1b9f650a410ea211a19b6"}
Jul 21 16:28:00.245229 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.245161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal" event={"ID":"d999f00e0a39ba2e8ae365bc665ef639","Type":"ContainerStarted","Data":"0b267adb76945a7f2e4fce79f4e51f9a18a3ff96a43bdbf52463b81a42e4881c"}
Jul 21 16:28:00.252271 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-netns\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.252450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-tmp-dir\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.252450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.252450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-registration-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.252450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-lib-modules\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.252450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-host\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.252450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0c5d24b-dba5-4804-8495-88e05b907254-etc-tuned\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c5d24b-dba5-4804-8495-88e05b907254-tmp\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-os-release\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysconfig\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-cni-binary-copy\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-tmp-dir\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-hostroot\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-multus-certs\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrd7l\" (UniqueName: \"kubernetes.io/projected/00314b86-e6f3-4785-9870-ace7beeb1caa-kube-api-access-zrd7l\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.252774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-etc-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-kubernetes\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-var-lib-kubelet\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-node-log\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbp5j\" (UniqueName: \"kubernetes.io/projected/e0c5d24b-dba5-4804-8495-88e05b907254-kube-api-access-kbp5j\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-conf-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-kubelet\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.252982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cnibin\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/178d726d-fd35-4d00-acc6-48ba0c1b56c4-host-slash\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rsrz\" (UniqueName: \"kubernetes.io/projected/178d726d-fd35-4d00-acc6-48ba0c1b56c4-kube-api-access-5rsrz\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-run-netns\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovnkube-config\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysctl-d\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.253205 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysctl-conf\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-os-release\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-cni-bin\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9caf168e-ecbf-41a3-a16e-eefd37999650-konnectivity-ca\") pod \"konnectivity-agent-9m6mx\" (UID: \"9caf168e-ecbf-41a3-a16e-eefd37999650\") " pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-env-overrides\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d5760a6-59bf-4b99-bf09-c3834f29411c-serviceca\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpvdj\" (UniqueName: \"kubernetes.io/projected/4d5760a6-59bf-4b99-bf09-c3834f29411c-kube-api-access-wpvdj\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-hosts-file\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkn2n\" (UniqueName: \"kubernetes.io/projected/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-kube-api-access-gkn2n\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/178d726d-fd35-4d00-acc6-48ba0c1b56c4-iptables-alerter-script\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-daemon-config\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52c5b102-a3da-43a7-867e-d143f298e61b-kubelet-config\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfk2k\" (UniqueName: \"kubernetes.io/projected/2dde5790-b27a-427e-a465-c8f702b37f81-kube-api-access-nfk2k\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d5760a6-59bf-4b99-bf09-c3834f29411c-host\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-cni-multus\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qrd\" (UniqueName: \"kubernetes.io/projected/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-kube-api-access-j2qrd\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52c5b102-a3da-43a7-867e-d143f298e61b-dbus\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.253806 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-var-lib-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovnkube-script-lib\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9caf168e-ecbf-41a3-a16e-eefd37999650-konnectivity-ca\") pod \"konnectivity-agent-9m6mx\" (UID: \"9caf168e-ecbf-41a3-a16e-eefd37999650\") " pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-run\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9caf168e-ecbf-41a3-a16e-eefd37999650-agent-certs\") pod \"konnectivity-agent-9m6mx\" (UID: \"9caf168e-ecbf-41a3-a16e-eefd37999650\") " pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovn-node-metrics-cert\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-hosts-file\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnnl\" (UniqueName: \"kubernetes.io/projected/6a8fe050-5148-4c6a-b492-c3fc7eddf218-kube-api-access-dhnnl\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.253977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-k8s-cni-cncf-io\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-kubelet\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-etc-kubernetes\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-systemd-units\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-slash\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.254722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-device-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-modprobe-d\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-system-cni-dir\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254275    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-log-socket\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-cni-netd\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-socket-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-sys-fs\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-systemd\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-ovn\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-cni-bin\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-sys\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7whvp\" (UniqueName: \"kubernetes.io/projected/7fb1e19a-cf5c-4c19-861c-fa81934b8727-kube-api-access-7whvp\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.255533 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-system-cni-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-socket-dir-parent\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-systemd\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-cni-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-cnibin\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.254669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.254831    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:00.256153 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.254903    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.754874105 +0000 UTC m=+3.022866760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:00.258494 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.258467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9caf168e-ecbf-41a3-a16e-eefd37999650-agent-certs\") pod \"konnectivity-agent-9m6mx\" (UID: \"9caf168e-ecbf-41a3-a16e-eefd37999650\") " pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.261847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.261816    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrd7l\" (UniqueName: \"kubernetes.io/projected/00314b86-e6f3-4785-9870-ace7beeb1caa-kube-api-access-zrd7l\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.261970 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.261895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkn2n\" (UniqueName: \"kubernetes.io/projected/82fd1bab-16d3-4a93-b99d-6cd2c790ce4c-kube-api-access-gkn2n\") pod \"node-resolver-7t5gx\" (UID: \"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c\") " pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.262774 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.262749    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:00.262774 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.262777    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:00.262946 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.262793    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:00.262946 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.262872    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.762850811 +0000 UTC m=+3.030843472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:00.355431 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-netns\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.355431 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-registration-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-netns\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-lib-modules\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-host\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0c5d24b-dba5-4804-8495-88e05b907254-etc-tuned\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-registration-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c5d24b-dba5-4804-8495-88e05b907254-tmp\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-os-release\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.355696 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-host\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysconfig\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-lib-modules\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-cni-binary-copy\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-os-release\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-hostroot\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-multus-certs\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-etc-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-multus-certs\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-kubernetes\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-var-lib-kubelet\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-node-log\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.355938    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysconfig\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.356000    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.855978829 +0000 UTC m=+3.123971483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:00.356031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbp5j\" (UniqueName: \"kubernetes.io/projected/e0c5d24b-dba5-4804-8495-88e05b907254-kube-api-access-kbp5j\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-conf-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.355819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-hostroot\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-kubelet\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-etc-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cnibin\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356180    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cnibin\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/178d726d-fd35-4d00-acc6-48ba0c1b56c4-host-slash\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-var-lib-kubelet\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rsrz\" (UniqueName: \"kubernetes.io/projected/178d726d-fd35-4d00-acc6-48ba0c1b56c4-kube-api-access-5rsrz\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356268    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-conf-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-run-netns\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-node-log\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovnkube-config\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-kubernetes\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-cni-binary-copy\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/178d726d-fd35-4d00-acc6-48ba0c1b56c4-host-slash\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.356917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysctl-d\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-run-netns\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-kubelet\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysctl-d\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysctl-conf\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-os-release\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-cni-bin\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-env-overrides\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d5760a6-59bf-4b99-bf09-c3834f29411c-serviceca\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356649    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpvdj\" (UniqueName: \"kubernetes.io/projected/4d5760a6-59bf-4b99-bf09-c3834f29411c-kube-api-access-wpvdj\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-os-release\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/178d726d-fd35-4d00-acc6-48ba0c1b56c4-iptables-alerter-script\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-daemon-config\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52c5b102-a3da-43a7-867e-d143f298e61b-kubelet-config\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356762    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfk2k\" (UniqueName: \"kubernetes.io/projected/2dde5790-b27a-427e-a465-c8f702b37f81-kube-api-access-nfk2k\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d5760a6-59bf-4b99-bf09-c3834f29411c-host\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-cni-multus\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qrd\" (UniqueName: \"kubernetes.io/projected/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-kube-api-access-j2qrd\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.357882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52c5b102-a3da-43a7-867e-d143f298e61b-dbus\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-var-lib-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovnkube-script-lib\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356934    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356980    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovnkube-config\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-run\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357027    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d5760a6-59bf-4b99-bf09-c3834f29411c-host\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-var-lib-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovn-node-metrics-cert\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-env-overrides\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357101    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d5760a6-59bf-4b99-bf09-c3834f29411c-serviceca\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-cni-multus\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357137    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-cni-bin\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnnl\" (UniqueName: \"kubernetes.io/projected/6a8fe050-5148-4c6a-b492-c3fc7eddf218-kube-api-access-dhnnl\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-run\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-k8s-cni-cncf-io\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-kubelet\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357321    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52c5b102-a3da-43a7-867e-d143f298e61b-dbus\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-etc-kubernetes\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-etc-kubernetes\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-systemd-units\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-slash\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-device-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-modprobe-d\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-system-cni-dir\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-log-socket\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-cni-netd\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/178d726d-fd35-4d00-acc6-48ba0c1b56c4-iptables-alerter-script\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.359961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovnkube-script-lib\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.356675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-sysctl-conf\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357815    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-socket-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-sys-fs\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-systemd\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-socket-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-ovn\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.357993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-cni-bin\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-systemd-units\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-sys\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7whvp\" (UniqueName: \"kubernetes.io/projected/7fb1e19a-cf5c-4c19-861c-fa81934b8727-kube-api-access-7whvp\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-system-cni-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-system-cni-dir\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-run-k8s-cni-cncf-io\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-system-cni-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.360867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-socket-dir-parent\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-systemd\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-sys-fs\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-systemd\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-cni-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-daemon-config\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-cnibin\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-cni-dir\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52c5b102-a3da-43a7-867e-d143f298e61b-kubelet-config\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-host-var-lib-kubelet\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dde5790-b27a-427e-a465-c8f702b37f81-device-dir\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-ovn\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-multus-socket-dir-parent\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-slash\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358639    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-log-socket\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fb1e19a-cf5c-4c19-861c-fa81934b8727-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.361880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-openvswitch\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-cni-netd\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-run-systemd\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-cnibin\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-etc-modprobe-d\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358799    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0c5d24b-dba5-4804-8495-88e05b907254-sys\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fb1e19a-cf5c-4c19-861c-fa81934b8727-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358891    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a8fe050-5148-4c6a-b492-c3fc7eddf218-host-cni-bin\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.358919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c5d24b-dba5-4804-8495-88e05b907254-tmp\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.359029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0c5d24b-dba5-4804-8495-88e05b907254-etc-tuned\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.362846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.362113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a8fe050-5148-4c6a-b492-c3fc7eddf218-ovn-node-metrics-cert\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.366856 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.366785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rsrz\" (UniqueName: \"kubernetes.io/projected/178d726d-fd35-4d00-acc6-48ba0c1b56c4-kube-api-access-5rsrz\") pod \"iptables-alerter-r5mt4\" (UID: \"178d726d-fd35-4d00-acc6-48ba0c1b56c4\") " pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.372739 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.372707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbp5j\" (UniqueName: \"kubernetes.io/projected/e0c5d24b-dba5-4804-8495-88e05b907254-kube-api-access-kbp5j\") pod \"tuned-w5xzg\" (UID: \"e0c5d24b-dba5-4804-8495-88e05b907254\") " pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.373177 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.373124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7whvp\" (UniqueName: \"kubernetes.io/projected/7fb1e19a-cf5c-4c19-861c-fa81934b8727-kube-api-access-7whvp\") pod \"multus-additional-cni-plugins-4fhjx\" (UID: \"7fb1e19a-cf5c-4c19-861c-fa81934b8727\") " pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.374871 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.374847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpvdj\" (UniqueName: \"kubernetes.io/projected/4d5760a6-59bf-4b99-bf09-c3834f29411c-kube-api-access-wpvdj\") pod \"node-ca-m6nn9\" (UID: \"4d5760a6-59bf-4b99-bf09-c3834f29411c\") " pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.375626 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.375605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnnl\" (UniqueName: \"kubernetes.io/projected/6a8fe050-5148-4c6a-b492-c3fc7eddf218-kube-api-access-dhnnl\") pod \"ovnkube-node-dfnjx\" (UID: \"6a8fe050-5148-4c6a-b492-c3fc7eddf218\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.375920 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.375898    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qrd\" (UniqueName: \"kubernetes.io/projected/9f01e1ef-0f1f-4199-b8b1-a25796a958ae-kube-api-access-j2qrd\") pod \"multus-pk7sq\" (UID: \"9f01e1ef-0f1f-4199-b8b1-a25796a958ae\") " pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.375977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.375903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfk2k\" (UniqueName: \"kubernetes.io/projected/2dde5790-b27a-427e-a465-c8f702b37f81-kube-api-access-nfk2k\") pod \"aws-ebs-csi-driver-node-fb8nt\" (UID: \"2dde5790-b27a-427e-a465-c8f702b37f81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.448223 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.448160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7t5gx"
Jul 21 16:28:00.456476 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.456440    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:00.469882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.469843    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:00.476266 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.476225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt"
Jul 21 16:28:00.484410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.484383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w5xzg"
Jul 21 16:28:00.492429 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.492404    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6nn9"
Jul 21 16:28:00.501430 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.501398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4fhjx"
Jul 21 16:28:00.510398 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.510371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pk7sq"
Jul 21 16:28:00.518350 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.518324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r5mt4"
Jul 21 16:28:00.762980 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.762940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:00.763201 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.763011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:00.763201 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.763161    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:00.763201 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.763169    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:00.763201 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.763186    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:00.763201 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.763197    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:00.763480 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.763270    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:28:01.763248757 +0000 UTC m=+4.031241414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:00.763480 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.763296    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:01.763277991 +0000 UTC m=+4.031270670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:00.863538 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:00.863495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:00.863754 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.863691    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:00.863833 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:00.863781    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:28:01.863757922 +0000 UTC m=+4.131750579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:01.178420 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:01.178326    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:23:00 +0000 UTC" deadline="2028-04-04 20:51:25.659061824 +0000 UTC"
Jul 21 16:28:01.178420 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:01.178369    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14956h23m24.480696705s"
Jul 21 16:28:01.438597 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:01.438562    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5760a6_59bf_4b99_bf09_c3834f29411c.slice/crio-4113488ef0769b2c96806f7e8221144a53ba8c75daa3d69cff91597779c62368 WatchSource:0}: Error finding container 4113488ef0769b2c96806f7e8221144a53ba8c75daa3d69cff91597779c62368: Status 404 returned error can't find the container with id 4113488ef0769b2c96806f7e8221144a53ba8c75daa3d69cff91597779c62368
Jul 21 16:28:01.461663 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:01.461628    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c5d24b_dba5_4804_8495_88e05b907254.slice/crio-b50d97defdce6b48c88c1f87ab8754068e212fe6f5c5a402f1ee70c0e23296b6 WatchSource:0}: Error finding container b50d97defdce6b48c88c1f87ab8754068e212fe6f5c5a402f1ee70c0e23296b6: Status 404 returned error can't find the container with id b50d97defdce6b48c88c1f87ab8754068e212fe6f5c5a402f1ee70c0e23296b6
Jul 21 16:28:01.462547 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:01.462345    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f01e1ef_0f1f_4199_b8b1_a25796a958ae.slice/crio-9c8679fa337fbf6e63604eecd40c153495b4579bdbd948c0afa759729886586f WatchSource:0}: Error finding container 9c8679fa337fbf6e63604eecd40c153495b4579bdbd948c0afa759729886586f: Status 404 returned error can't find the container with id 9c8679fa337fbf6e63604eecd40c153495b4579bdbd948c0afa759729886586f
Jul 21 16:28:01.463869 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:01.463765    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dde5790_b27a_427e_a465_c8f702b37f81.slice/crio-49bd612560aa5bce98437a58d9d0f930d3f5238cb13c0b64bfaa29470aa62571 WatchSource:0}: Error finding container 49bd612560aa5bce98437a58d9d0f930d3f5238cb13c0b64bfaa29470aa62571: Status 404 returned error can't find the container with id 49bd612560aa5bce98437a58d9d0f930d3f5238cb13c0b64bfaa29470aa62571
Jul 21 16:28:01.476183 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:01.475936    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8fe050_5148_4c6a_b492_c3fc7eddf218.slice/crio-34dcfb47b8f1f2891976ecdcea66ef550e55b575bfca9fb4f3f2725fa90cc92c WatchSource:0}: Error finding container 34dcfb47b8f1f2891976ecdcea66ef550e55b575bfca9fb4f3f2725fa90cc92c: Status 404 returned error can't find the container with id 34dcfb47b8f1f2891976ecdcea66ef550e55b575bfca9fb4f3f2725fa90cc92c
Jul 21 16:28:01.771370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:01.771318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:01.771537 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:01.771410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:01.771537 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.771500    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:01.771614 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.771529    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:01.771614 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.771554    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:01.771614 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.771565    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:01.771614 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.771572    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:28:03.771555857 +0000 UTC m=+6.039548513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:01.771614 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.771607    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:03.771593403 +0000 UTC m=+6.039586055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:01.872467 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:01.872426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:01.872655 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.872604    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:01.872693 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:01.872680    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:28:03.872662403 +0000 UTC m=+6.140655057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:02.156316 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.156278    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:02.179228 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.179097    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:23:00 +0000 UTC" deadline="2028-01-29 23:27:36.220904769 +0000 UTC"
Jul 21 16:28:02.179228 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.179172    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13374h59m34.04173765s"
Jul 21 16:28:02.239411 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.239377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:02.239616 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:02.239529    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:02.240003 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.239978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:02.240119 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:02.240102    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:02.246291 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.242349    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:02.246291 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:02.242462    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:02.264275 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.263923    2575 generic.go:356] "Generic (PLEG): container finished" podID="d999f00e0a39ba2e8ae365bc665ef639" containerID="a5476612d6f66feac3b656985310ee946e2f9542f51505b1aac8a978004a49b4" exitCode=0
Jul 21 16:28:02.264275 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.264044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal" event={"ID":"d999f00e0a39ba2e8ae365bc665ef639","Type":"ContainerDied","Data":"a5476612d6f66feac3b656985310ee946e2f9542f51505b1aac8a978004a49b4"}
Jul 21 16:28:02.277654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.277507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerStarted","Data":"0da31d53ba9c8ea6aca341afb5d6e5b7e21be7d730ceb261a3bb290924265c76"}
Jul 21 16:28:02.286990 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.286951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7t5gx" event={"ID":"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c","Type":"ContainerStarted","Data":"ceb723d88ff72d98459fc264a4150842550ac065706a052037ae5e68f4ed1109"}
Jul 21 16:28:02.292567 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.292527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt" event={"ID":"2dde5790-b27a-427e-a465-c8f702b37f81","Type":"ContainerStarted","Data":"49bd612560aa5bce98437a58d9d0f930d3f5238cb13c0b64bfaa29470aa62571"}
Jul 21 16:28:02.295779 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.295743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pk7sq" event={"ID":"9f01e1ef-0f1f-4199-b8b1-a25796a958ae","Type":"ContainerStarted","Data":"9c8679fa337fbf6e63604eecd40c153495b4579bdbd948c0afa759729886586f"}
Jul 21 16:28:02.299588 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.299554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w5xzg" event={"ID":"e0c5d24b-dba5-4804-8495-88e05b907254","Type":"ContainerStarted","Data":"b50d97defdce6b48c88c1f87ab8754068e212fe6f5c5a402f1ee70c0e23296b6"}
Jul 21 16:28:02.306059 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.306019    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6nn9" event={"ID":"4d5760a6-59bf-4b99-bf09-c3834f29411c","Type":"ContainerStarted","Data":"4113488ef0769b2c96806f7e8221144a53ba8c75daa3d69cff91597779c62368"}
Jul 21 16:28:02.310609 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.310572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal" event={"ID":"a1e91e225a0145e17a81d6cda6c1fe8a","Type":"ContainerStarted","Data":"a6549b2d5b6cf4c47f17aae30c2a55095bd7e115a6abd7fbddce2a4f7136ca7c"}
Jul 21 16:28:02.327839 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.327767    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-98.ec2.internal" podStartSLOduration=3.327742782 podStartE2EDuration="3.327742782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:02.327383998 +0000 UTC m=+4.595376678" watchObservedRunningTime="2026-07-21 16:28:02.327742782 +0000 UTC m=+4.595735463"
Jul 21 16:28:02.341444 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.341398    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"34dcfb47b8f1f2891976ecdcea66ef550e55b575bfca9fb4f3f2725fa90cc92c"}
Jul 21 16:28:02.353813 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.353769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r5mt4" event={"ID":"178d726d-fd35-4d00-acc6-48ba0c1b56c4","Type":"ContainerStarted","Data":"1997dc09a46ed83a3e6140b1f5296c8eadbd186f77b727220190d1c55c255f2e"}
Jul 21 16:28:02.372790 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:02.372746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9m6mx" event={"ID":"9caf168e-ecbf-41a3-a16e-eefd37999650","Type":"ContainerStarted","Data":"ec5065b31913569de1e52da405fd05ddb0dcf971e804bfbb747e54fe395876ba"}
Jul 21 16:28:03.392011 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:03.391790    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal" event={"ID":"d999f00e0a39ba2e8ae365bc665ef639","Type":"ContainerStarted","Data":"44b4673e9e1f224e8ab9e4f11dad53848b0454135f34c8bfa72df2254576b539"}
Jul 21 16:28:03.788283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:03.788231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:03.788490 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:03.788295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:03.788490 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.788484    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:03.788620 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.788552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.788533233 +0000 UTC m=+10.056525905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:03.789192 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.789012    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:03.789192 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.789038    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:03.789192 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.789052    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:03.789192 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.789101    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.789084506 +0000 UTC m=+10.057077179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:03.889242 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:03.889180    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:03.889434 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.889382    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:03.889500 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:03.889450    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:28:07.889430809 +0000 UTC m=+10.157423474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:04.240918 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:04.240836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:04.241087 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:04.240843    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:04.241087 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:04.240981    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:04.241087 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:04.241016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:04.241291 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:04.241126    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:04.241291 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:04.241231    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:06.240331 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:06.240298    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:06.240934 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:06.240441    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:06.240934 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:06.240764    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:06.240934 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:06.240837    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:06.240934 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:06.240885    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:06.241180 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:06.240939    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:07.823896 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:07.823841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:07.823936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.824024    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.824028    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.824049    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.824061    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.824092    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:28:15.824073157 +0000 UTC m=+18.092065812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:07.824382 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.824109    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:15.82410077 +0000 UTC m=+18.092093425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:07.924692 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:07.924653    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:07.924898 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.924840    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:07.924974 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:07.924919    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:28:15.924899196 +0000 UTC m=+18.192891867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:08.240666 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:08.240571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:08.240833 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:08.240707    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:08.241124 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:08.241105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:08.241241 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:08.241221    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:08.241340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:08.241325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:08.241432 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:08.241413    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:10.240873 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:10.240307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:10.240873 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:10.240320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:10.240873 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:10.240463    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:10.240873 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:10.240486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:10.240873 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:10.240592    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:10.240873 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:10.240677    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:12.239673 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:12.239635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:12.240156 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:12.239637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:12.240156 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:12.239790    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:12.240156 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:12.239648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:12.240156 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:12.239883    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:12.240156 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:12.239919    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:14.239335 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:14.239296    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:14.239758 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:14.239296    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:14.239758 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:14.239432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:14.239758 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:14.239432    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:14.239758 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:14.239551    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:14.239758 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:14.239630    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:15.889624 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:15.889587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:15.889624 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:15.889633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:15.890259 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.889739    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:15.890259 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.889801    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:15.890259 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.889820    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:28:31.889799044 +0000 UTC m=+34.157791728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:15.890259 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.889828    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:15.890259 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.889842    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:15.890259 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.889894    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:31.889878594 +0000 UTC m=+34.157871252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:15.990946 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:15.990905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:15.991115 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.991084    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:15.991193 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:15.991180    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:28:31.991141029 +0000 UTC m=+34.259133691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:16.239635 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:16.239539    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:16.239798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:16.239539    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:16.239798 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:16.239663    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:16.239798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:16.239549    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:16.239798 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:16.239726    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:16.240029 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:16.239825    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:18.239959 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:18.239920    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:18.240428 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:18.240013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:18.240428 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:18.240035    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:18.240428 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:18.240142    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:18.240428 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:18.240230    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:18.240428 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:18.240368    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:20.239408 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:20.239380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:20.239408 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:20.239408    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:20.240003 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:20.239380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:20.240003 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:20.239500    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:20.240003 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:20.239575    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:20.240003 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:20.239657    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:21.438502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.437980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7t5gx" event={"ID":"82fd1bab-16d3-4a93-b99d-6cd2c790ce4c","Type":"ContainerStarted","Data":"2e40602bdc43d581fa9f9f445a03d7f7315c091e6e6cf830233dc6ce050ab082"}
Jul 21 16:28:21.440031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.439999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt" event={"ID":"2dde5790-b27a-427e-a465-c8f702b37f81","Type":"ContainerStarted","Data":"303a6f2a795403e16dd1aa4a274c8a9ccb6289810d0baa8f31879c1d47039417"}
Jul 21 16:28:21.441698 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.441671    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pk7sq" event={"ID":"9f01e1ef-0f1f-4199-b8b1-a25796a958ae","Type":"ContainerStarted","Data":"9e6d5b7eea9f39a15e9e6b31f10cde7d90d61dc3bf3334d3fed5d86da74ea15f"}
Jul 21 16:28:21.443404 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.443376    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w5xzg" event={"ID":"e0c5d24b-dba5-4804-8495-88e05b907254","Type":"ContainerStarted","Data":"975d2d4c0585f436df32b0fee7d7332bdf18d47497a46e2b4fbca1314b4c361a"}
Jul 21 16:28:21.445122 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.445098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6nn9" event={"ID":"4d5760a6-59bf-4b99-bf09-c3834f29411c","Type":"ContainerStarted","Data":"9987f18f4a1a1ee90d4d64c9664857e21d79ce22ab38e54f258053b9b4641575"}
Jul 21 16:28:21.448820 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.448790    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"082897deeec3b394a1c693a6463af6037637cce96ef9156776e25754cec72baf"}
Jul 21 16:28:21.448953 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.448872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"b2576d06408528dc536bc15ea71f7557ba4ab7d54287b6f2a3b0cf7779c89e21"}
Jul 21 16:28:21.448953 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.448924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"ebf16cc1e862e1941af37a40571a75500ed106e24c0b46c8d5035b15c4abfdd2"}
Jul 21 16:28:21.449064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.448974    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"779537d376a378ef1c84170341ee49a5f8a912185490bdaf1213ceb287f50e72"}
Jul 21 16:28:21.449064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.449024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"c1790e1cba3f17c824881a245e7d51e166881148a4604fcc924a7993372a8bdd"}
Jul 21 16:28:21.449151 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.449068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"82cc340e1485a7d5d5f527e02a61f2bad72760663a50fef4d8be63035c6a7cf0"}
Jul 21 16:28:21.450485 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.450457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9m6mx" event={"ID":"9caf168e-ecbf-41a3-a16e-eefd37999650","Type":"ContainerStarted","Data":"70962f2a3e8d2b8a6dab9c787daf9411a6e8b023cc4559fef2c37a241c859553"}
Jul 21 16:28:21.452084 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.452055    2575 generic.go:356] "Generic (PLEG): container finished" podID="7fb1e19a-cf5c-4c19-861c-fa81934b8727" containerID="cd423705d7dd184a058222d8896d9a21ad6067be0ec81a91f37e3b9bd9981176" exitCode=0
Jul 21 16:28:21.452212 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.452096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerDied","Data":"cd423705d7dd184a058222d8896d9a21ad6067be0ec81a91f37e3b9bd9981176"}
Jul 21 16:28:21.453524 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.453435    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7t5gx" podStartSLOduration=4.326745683 podStartE2EDuration="23.45342182s" totalImagesPullingTime="19.126676137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:21.452287986 +0000 UTC m=+23.720280661" watchObservedRunningTime="2026-07-21 16:28:21.45342182 +0000 UTC m=+23.721414495"
Jul 21 16:28:21.453591 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.453543    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-98.ec2.internal" podStartSLOduration=22.453538181 podStartE2EDuration="22.453538181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:03.407508514 +0000 UTC m=+5.675501189" watchObservedRunningTime="2026-07-21 16:28:21.453538181 +0000 UTC m=+23.721530852"
Jul 21 16:28:21.466950 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.466893    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9m6mx" podStartSLOduration=8.581736141 podStartE2EDuration="23.466871608s" totalImagesPullingTime="14.885135467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:21.466143755 +0000 UTC m=+23.734136429" watchObservedRunningTime="2026-07-21 16:28:21.466871608 +0000 UTC m=+23.734864284"
Jul 21 16:28:21.480036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.479970    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m6nn9" podStartSLOduration=4.330455489 podStartE2EDuration="23.479947594s" totalImagesPullingTime="19.149492105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:21.479680065 +0000 UTC m=+23.747672732" watchObservedRunningTime="2026-07-21 16:28:21.479947594 +0000 UTC m=+23.747940269"
Jul 21 16:28:21.497902 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:21.497841    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w5xzg" podStartSLOduration=4.36107932 podStartE2EDuration="23.497824536s" totalImagesPullingTime="19.136745216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:21.497510567 +0000 UTC m=+23.765503245" watchObservedRunningTime="2026-07-21 16:28:21.497824536 +0000 UTC m=+23.765817273"
Jul 21 16:28:22.144908 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.144869    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 16:28:22.203440 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.203309    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:28:22.144895751Z","UUID":"68bc2231-a000-4862-a949-004f0075cedd","Handler":null,"Name":"","Endpoint":""}
Jul 21 16:28:22.204978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.204945    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 16:28:22.204978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.204984    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 16:28:22.239237 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.239205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:22.239424 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.239211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:22.239424 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.239328    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:22.239424 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:22.239333    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:22.239424 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:22.239417    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:22.239659 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:22.239541    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:22.457075 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.456976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r5mt4" event={"ID":"178d726d-fd35-4d00-acc6-48ba0c1b56c4","Type":"ContainerStarted","Data":"bdd0ce649044591bfb6d91f4a77e0e54370a7dd4361a0933a49b0cf2774c67b6"}
Jul 21 16:28:22.459495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.459460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt" event={"ID":"2dde5790-b27a-427e-a465-c8f702b37f81","Type":"ContainerStarted","Data":"fb166dde7bbfe2ee3394a93c7f7c37fc683d35b37bc5039e7f271bc56db0def6"}
Jul 21 16:28:22.474919 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.474859    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pk7sq" podStartSLOduration=5.271265028 podStartE2EDuration="24.474835903s" totalImagesPullingTime="19.203570875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:21.551291632 +0000 UTC m=+23.819284305" watchObservedRunningTime="2026-07-21 16:28:22.474835903 +0000 UTC m=+24.742828578"
Jul 21 16:28:22.475104 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:22.475024    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r5mt4" podStartSLOduration=5.348186166 podStartE2EDuration="24.475013758s" totalImagesPullingTime="19.126827592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:22.473864391 +0000 UTC m=+24.741857066" watchObservedRunningTime="2026-07-21 16:28:22.475013758 +0000 UTC m=+24.743006434"
Jul 21 16:28:24.238993 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.238952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:24.239485 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.238952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:24.239485 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:24.239066    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:24.239485 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.239076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:24.239485 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:24.239209    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:24.239485 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:24.239313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:24.467355 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.467311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt" event={"ID":"2dde5790-b27a-427e-a465-c8f702b37f81","Type":"ContainerStarted","Data":"2fb42a68a7c39f7a845cc732ca928b27278074f29910b57c80b2fb1f571bbc06"}
Jul 21 16:28:24.471324 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.471282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"f670fc44e0147ddbf765ea609ed0cad2a1903b688f0a06bde302c674d86502f7"}
Jul 21 16:28:24.486995 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.486936    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb8nt" podStartSLOduration=8.980829692 podStartE2EDuration="26.486919876s" totalImagesPullingTime="17.506090184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:24.486634256 +0000 UTC m=+26.754626932" watchObservedRunningTime="2026-07-21 16:28:24.486919876 +0000 UTC m=+26.754912550"
Jul 21 16:28:24.619601 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.619571    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:24.620293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:24.620263    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:25.474541 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:25.474296    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:25.475031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:25.474873    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9m6mx"
Jul 21 16:28:26.239805 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:26.239771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:26.240034 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:26.239771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:26.243398 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:26.240329    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:26.243398 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:26.240572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:26.243398 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:26.240738    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:26.243398 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:26.240835    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:27.482481 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.482149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" event={"ID":"6a8fe050-5148-4c6a-b492-c3fc7eddf218","Type":"ContainerStarted","Data":"1e2e34e678541ab59e48ba195c1193233f73e35b43b8450c107cb91ab2021bf7"}
Jul 21 16:28:27.482481 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.482453    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:27.483334 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.482491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:27.484421 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.484383    2575 generic.go:356] "Generic (PLEG): container finished" podID="7fb1e19a-cf5c-4c19-861c-fa81934b8727" containerID="cdde27eb76a91baca94b15c649685688dd26467d0b8a06d923654791b3da33c5" exitCode=0
Jul 21 16:28:27.484548 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.484435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerDied","Data":"cdde27eb76a91baca94b15c649685688dd26467d0b8a06d923654791b3da33c5"}
Jul 21 16:28:27.499245 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.499220    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:27.512894 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:27.512848    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx" podStartSLOduration=10.322233975 podStartE2EDuration="29.512832363s" totalImagesPullingTime="19.190598388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:27.512425568 +0000 UTC m=+29.780418245" watchObservedRunningTime="2026-07-21 16:28:27.512832363 +0000 UTC m=+29.780825037"
Jul 21 16:28:28.239569 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:28.239522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:28.239807 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:28.239603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:28.239807 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:28.239621    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:28.239807 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:28.239741    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:28.239807 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:28.239773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:28.240054 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:28.239874    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:28.486747 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:28.486700    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:28.502794 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:28.502763    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:28:29.012727 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.012636    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vdds"]
Jul 21 16:28:29.012875 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.012739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:29.012875 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:29.012834    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:29.015511 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.015474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfhlt"]
Jul 21 16:28:29.015717 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.015608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:29.015794 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:29.015722    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:29.016313 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.016292    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnthg"]
Jul 21 16:28:29.016417 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.016373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:29.016482 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:29.016457    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:29.491401 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.491309    2575 generic.go:356] "Generic (PLEG): container finished" podID="7fb1e19a-cf5c-4c19-861c-fa81934b8727" containerID="6920dd313b66f2b5159e1701b8ede575ae6fe5bc151628feb9c249886cf9533c" exitCode=0
Jul 21 16:28:29.491401 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:29.491385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerDied","Data":"6920dd313b66f2b5159e1701b8ede575ae6fe5bc151628feb9c249886cf9533c"}
Jul 21 16:28:30.241311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:30.241230    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:30.241474 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:30.241372    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:30.241823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:30.241801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:30.241949 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:30.241899    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:31.238832 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:31.238605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:31.239205 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.238860    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:31.497385 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:31.497357    2575 generic.go:356] "Generic (PLEG): container finished" podID="7fb1e19a-cf5c-4c19-861c-fa81934b8727" containerID="0a10dad7fffd5d17736a5201c07b67326940553adaa8a935448c49082881c81e" exitCode=0
Jul 21 16:28:31.497525 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:31.497421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerDied","Data":"0a10dad7fffd5d17736a5201c07b67326940553adaa8a935448c49082881c81e"}
Jul 21 16:28:31.912966 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:31.912863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:31.912966 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:31.912908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:31.913138 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.913016    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:31.913138 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.913040    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:31.913138 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.913070    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:31.913138 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.913080    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dktbh for pod openshift-network-diagnostics/network-check-target-jfhlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:31.913138 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.913105    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs podName:00314b86-e6f3-4785-9870-ace7beeb1caa nodeName:}" failed. No retries permitted until 2026-07-21 16:29:03.913085494 +0000 UTC m=+66.181078147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs") pod "network-metrics-daemon-wnthg" (UID: "00314b86-e6f3-4785-9870-ace7beeb1caa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:31.913138 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:31.913125    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh podName:1778ec64-ca10-4871-877a-f82178097e18 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:03.913113943 +0000 UTC m=+66.181106595 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dktbh" (UniqueName: "kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh") pod "network-check-target-jfhlt" (UID: "1778ec64-ca10-4871-877a-f82178097e18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:32.014254 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:32.014216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:32.014464 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:32.014444    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:32.014604 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:32.014588    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret podName:52c5b102-a3da-43a7-867e-d143f298e61b nodeName:}" failed. No retries permitted until 2026-07-21 16:29:04.014564959 +0000 UTC m=+66.282557620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret") pod "global-pull-secret-syncer-5vdds" (UID: "52c5b102-a3da-43a7-867e-d143f298e61b") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:32.239453 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:32.239351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:32.239453 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:32.239353    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:32.240123 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:32.239482    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:32.240123 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:32.239583    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:33.239599 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:33.239567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:33.239964 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:33.239675    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vdds" podUID="52c5b102-a3da-43a7-867e-d143f298e61b"
Jul 21 16:28:34.239754 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.239720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:34.240346 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.239722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:34.240346 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.239867    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnthg" podUID="00314b86-e6f3-4785-9870-ace7beeb1caa"
Jul 21 16:28:34.240346 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.239941    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfhlt" podUID="1778ec64-ca10-4871-877a-f82178097e18"
Jul 21 16:28:34.587778 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.587750    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-98.ec2.internal" event="NodeReady"
Jul 21 16:28:34.588072 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.587886    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 16:28:34.623419 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.622494    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58b59cb77b-zj22b"]
Jul 21 16:28:34.624625 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.624596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.625292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.625265    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-n7j2x"]
Jul 21 16:28:34.627128 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.627101    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-775f4d885b-qwn7m"]
Jul 21 16:28:34.627411 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.627383    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 16:28:34.627503 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.627438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.627559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.627517    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 16:28:34.628001 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.627978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 16:28:34.628100 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.628083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9vz5j\""
Jul 21 16:28:34.628185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.628113    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 16:28:34.628185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.628083    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.628400 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.628384    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.628855 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.628837    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2zslp"]
Jul 21 16:28:34.628976 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.628958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.630473 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630453    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 16:28:34.630559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.630559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630479    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 16:28:34.630725 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"]
Jul 21 16:28:34.630791 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630769    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.630848 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630833    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-56tf2\""
Jul 21 16:28:34.630923 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.630904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.633027 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633530    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633594    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.633848    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.634047    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zkh7z\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.634231    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kr8fq\""
Jul 21 16:28:34.635195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.634653    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 16:28:34.638910 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.638890    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 21 16:28:34.639019 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.638945    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.639182 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.639151    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nxpnx\""
Jul 21 16:28:34.639251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.639159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.639251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.639202    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 21 16:28:34.640715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.640686    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 16:28:34.642473 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.641673    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 16:28:34.648604 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.648578    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 16:28:34.651254 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.651229    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58b59cb77b-zj22b"]
Jul 21 16:28:34.653091 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.653067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-n7j2x"]
Jul 21 16:28:34.655122 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.654938    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"]
Jul 21 16:28:34.656984 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.656961    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ps9h7"]
Jul 21 16:28:34.657127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.657107    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"
Jul 21 16:28:34.659526 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.659141    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"]
Jul 21 16:28:34.659996 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.659972    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.660079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.660039    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.660354 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.660335    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.660767 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.660750    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nrvlw\""
Jul 21 16:28:34.662404 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.662372    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4kgw6"]
Jul 21 16:28:34.662535 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.662496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fjqx\""
Jul 21 16:28:34.662885 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.662868    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 16:28:34.663331 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.663074    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 16:28:34.663532 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.663509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.664519 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.664499    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"]
Jul 21 16:28:34.664847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.664832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.666407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.665628    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.666407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.665972    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mftg9\""
Jul 21 16:28:34.666407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.666094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 21 16:28:34.666407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.666206    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.666407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.666259    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 21 16:28:34.668603 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.668582    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"]
Jul 21 16:28:34.670903 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.670878    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 16:28:34.671213 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.671197    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.671325 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.671304    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.671916 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.671306    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.671916 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.671362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c76lp\""
Jul 21 16:28:34.673226 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.673084    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"]
Jul 21 16:28:34.674016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.673775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 16:28:34.674016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.673805    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 16:28:34.674016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.673979    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:34.674222 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.674100    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dfttx\""
Jul 21 16:28:34.674372 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.674351    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.674372 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.674364    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.675398 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.675379    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"]
Jul 21 16:28:34.675471 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.675411    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775f4d885b-qwn7m"]
Jul 21 16:28:34.675471 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.675423    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2zslp"]
Jul 21 16:28:34.675471 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.675443    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"]
Jul 21 16:28:34.675580 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.675516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"
Jul 21 16:28:34.676495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.676476    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6pfhv\""
Jul 21 16:28:34.676584 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.676539    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.676641 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.676628    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.676768 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.676755    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 16:28:34.677560 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677540    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"]
Jul 21 16:28:34.677659 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677568    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"]
Jul 21 16:28:34.677659 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677587    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"]
Jul 21 16:28:34.677659 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677588    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d7xrx\""
Jul 21 16:28:34.677822 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677662    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4kgw6"]
Jul 21 16:28:34.677822 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"]
Jul 21 16:28:34.677822 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677706    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ps9h7"]
Jul 21 16:28:34.677822 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.677807    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:34.678328 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.678185    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:28:34.678328 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.678265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:28:34.680182 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.680149    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 21 16:28:34.680451 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.680345    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 21 16:28:34.680698 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.680681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-89xjl\""
Jul 21 16:28:34.682862 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.682823    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"]
Jul 21 16:28:34.684424 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.684405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"]
Jul 21 16:28:34.732605 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-stats-auth\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.732720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-trusted-ca\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.732720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-default-certificate\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.732720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgmq\" (UniqueName: \"kubernetes.io/projected/4aab204f-103a-4267-94af-f175c1cbc0df-kube-api-access-jxgmq\") pod \"ingress-canary-4kgw6\" (UID: \"4aab204f-103a-4267-94af-f175c1cbc0df\") " pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.732720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01e09e9b-370f-4ad3-8865-745845519116-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.732891 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aab204f-103a-4267-94af-f175c1cbc0df-cert\") pod \"ingress-canary-4kgw6\" (UID: \"4aab204f-103a-4267-94af-f175c1cbc0df\") " pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.732891 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrb7\" (UniqueName: \"kubernetes.io/projected/01e09e9b-370f-4ad3-8865-745845519116-kube-api-access-nkrb7\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.732891 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86kp\" (UniqueName: \"kubernetes.io/projected/28041f07-ca0f-4805-96c1-c23863f574a8-kube-api-access-s86kp\") pod \"volume-data-source-validator-78cf4c6f6-gbgp5\" (UID: \"28041f07-ca0f-4805-96c1-c23863f574a8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"
Jul 21 16:28:34.732891 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af52519d-6ccf-4525-b833-feabf84c514c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.733070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-config\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.733070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.732998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.733070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733023    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca29479a-4684-44ed-ab84-e83bb8676bab-config-volume\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.733070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmznl\" (UniqueName: \"kubernetes.io/projected/ff6d6bd9-9abb-4693-a65f-0cc455f79821-kube-api-access-rmznl\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.733249 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.733249 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01e09e9b-370f-4ad3-8865-745845519116-tmp\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.733249 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-ca-trust-extracted\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733249 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdd9q\" (UniqueName: \"kubernetes.io/projected/ca29479a-4684-44ed-ab84-e83bb8676bab-kube-api-access-jdd9q\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.733249 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-image-registry-private-configuration\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bxf\" (UniqueName: \"kubernetes.io/projected/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-kube-api-access-76bxf\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.733414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af52519d-6ccf-4525-b833-feabf84c514c-config\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.733414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-certificates\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqkwh\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-kube-api-access-gqkwh\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/819d4b8d-220e-4731-a09f-8138b4ac316c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.733414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29479a-4684-44ed-ab84-e83bb8676bab-tmp-dir\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-bound-sa-token\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708be621-6f4a-4a77-89b2-95fb2b98a435-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01e09e9b-370f-4ad3-8865-745845519116-snapshots\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-installation-pull-secrets\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-serving-cert\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjmz\" (UniqueName: \"kubernetes.io/projected/af52519d-6ccf-4525-b833-feabf84c514c-kube-api-access-wwjmz\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708be621-6f4a-4a77-89b2-95fb2b98a435-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01e09e9b-370f-4ad3-8865-745845519116-service-ca-bundle\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-trusted-ca\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01e09e9b-370f-4ad3-8865-745845519116-serving-cert\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms8l2\" (UniqueName: \"kubernetes.io/projected/708be621-6f4a-4a77-89b2-95fb2b98a435-kube-api-access-ms8l2\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.733690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.733680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsz9k\" (UniqueName: \"kubernetes.io/projected/819d4b8d-220e-4731-a09f-8138b4ac316c-kube-api-access-dsz9k\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.798623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.798591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:34.834008 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.833969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01e09e9b-370f-4ad3-8865-745845519116-tmp\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.834008 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-ca-trust-extracted\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.834295 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdd9q\" (UniqueName: \"kubernetes.io/projected/ca29479a-4684-44ed-ab84-e83bb8676bab-kube-api-access-jdd9q\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.834295 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-image-registry-private-configuration\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.834295 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76bxf\" (UniqueName: \"kubernetes.io/projected/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-kube-api-access-76bxf\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.834444 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af52519d-6ccf-4525-b833-feabf84c514c-config\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.834444 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-certificates\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.834444 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqkwh\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-kube-api-access-gqkwh\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.834444 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/819d4b8d-220e-4731-a09f-8138b4ac316c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.834629 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01e09e9b-370f-4ad3-8865-745845519116-tmp\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.834723 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29479a-4684-44ed-ab84-e83bb8676bab-tmp-dir\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.834871 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834850    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-ca-trust-extracted\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.834948 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca29479a-4684-44ed-ab84-e83bb8676bab-tmp-dir\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.834948 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-bound-sa-token\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.834948 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708be621-6f4a-4a77-89b2-95fb2b98a435-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.835085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01e09e9b-370f-4ad3-8865-745845519116-snapshots\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.835085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-installation-pull-secrets\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.835085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.834994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-serving-cert\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.835085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-certificates\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.835085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7pzm\" (UniqueName: \"kubernetes.io/projected/d45b949e-2f71-4424-861f-2800c30ab2d4-kube-api-access-b7pzm\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjmz\" (UniqueName: \"kubernetes.io/projected/af52519d-6ccf-4525-b833-feabf84c514c-kube-api-access-wwjmz\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/819d4b8d-220e-4731-a09f-8138b4ac316c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708be621-6f4a-4a77-89b2-95fb2b98a435-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01e09e9b-370f-4ad3-8865-745845519116-service-ca-bundle\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-trusted-ca\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.835339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5ljd\" (UniqueName: \"kubernetes.io/projected/639d57ea-c490-4663-aefd-9f5f65e4d43a-kube-api-access-s5ljd\") pod \"network-check-source-7bc5b6bf85-lxfsf\" (UID: \"639d57ea-c490-4663-aefd-9f5f65e4d43a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92f64932-2fc7-4438-bc0e-6b8858c142c5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01e09e9b-370f-4ad3-8865-745845519116-serving-cert\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms8l2\" (UniqueName: \"kubernetes.io/projected/708be621-6f4a-4a77-89b2-95fb2b98a435-kube-api-access-ms8l2\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835457    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsz9k\" (UniqueName: \"kubernetes.io/projected/819d4b8d-220e-4731-a09f-8138b4ac316c-kube-api-access-dsz9k\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-stats-auth\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-trusted-ca\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-default-certificate\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgmq\" (UniqueName: \"kubernetes.io/projected/4aab204f-103a-4267-94af-f175c1cbc0df-kube-api-access-jxgmq\") pod \"ingress-canary-4kgw6\" (UID: \"4aab204f-103a-4267-94af-f175c1cbc0df\") " pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01e09e9b-370f-4ad3-8865-745845519116-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aab204f-103a-4267-94af-f175c1cbc0df-cert\") pod \"ingress-canary-4kgw6\" (UID: \"4aab204f-103a-4267-94af-f175c1cbc0df\") " pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrb7\" (UniqueName: \"kubernetes.io/projected/01e09e9b-370f-4ad3-8865-745845519116-kube-api-access-nkrb7\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835635    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708be621-6f4a-4a77-89b2-95fb2b98a435-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.835715 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s86kp\" (UniqueName: \"kubernetes.io/projected/28041f07-ca0f-4805-96c1-c23863f574a8-kube-api-access-s86kp\") pod \"volume-data-source-validator-78cf4c6f6-gbgp5\" (UID: \"28041f07-ca0f-4805-96c1-c23863f574a8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af52519d-6ccf-4525-b833-feabf84c514c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-config\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca29479a-4684-44ed-ab84-e83bb8676bab-config-volume\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmznl\" (UniqueName: \"kubernetes.io/projected/ff6d6bd9-9abb-4693-a65f-0cc455f79821-kube-api-access-rmznl\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.835878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.835991    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.836053    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls podName:ca29479a-4684-44ed-ab84-e83bb8676bab nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.336035894 +0000 UTC m=+37.604028548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls") pod "dns-default-ps9h7" (UID: "ca29479a-4684-44ed-ab84-e83bb8676bab") : secret "dns-default-metrics-tls" not found
Jul 21 16:28:34.836391 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.836214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af52519d-6ccf-4525-b833-feabf84c514c-config\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.836838 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.836660    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:34.836838 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.836728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls podName:819d4b8d-220e-4731-a09f-8138b4ac316c nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.336710788 +0000 UTC m=+37.604703446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v8q69" (UID: "819d4b8d-220e-4731-a09f-8138b4ac316c") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:34.837031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.837008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01e09e9b-370f-4ad3-8865-745845519116-service-ca-bundle\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.838377 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.837394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-config\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.838377 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.837494    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:28:34.838377 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.837508    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f4d885b-qwn7m: secret "image-registry-tls" not found
Jul 21 16:28:34.838377 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.837550    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls podName:b059965e-ba61-4fa1-b8bb-891c9fc3a56a nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.337535617 +0000 UTC m=+37.605528272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls") pod "image-registry-775f4d885b-qwn7m" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a") : secret "image-registry-tls" not found
Jul 21 16:28:34.838377 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.838041    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.338020529 +0000 UTC m=+37.606013204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : configmap references non-existent config key: service-ca.crt
Jul 21 16:28:34.838377 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.838239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-trusted-ca\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.839247 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.839227    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-trusted-ca\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.839922 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.839298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca29479a-4684-44ed-ab84-e83bb8676bab-config-volume\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.840047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.840020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708be621-6f4a-4a77-89b2-95fb2b98a435-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.840145 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.840124    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:28:34.840231 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.840196    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.340179632 +0000 UTC m=+37.608172300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : secret "router-metrics-certs-default" not found
Jul 21 16:28:34.840231 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.840207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01e09e9b-370f-4ad3-8865-745845519116-snapshots\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.843495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.841655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-image-registry-private-configuration\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.843495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.841673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01e09e9b-370f-4ad3-8865-745845519116-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.843495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.842349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-serving-cert\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.843495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.842754    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-default-certificate\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.843818 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.843638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aab204f-103a-4267-94af-f175c1cbc0df-cert\") pod \"ingress-canary-4kgw6\" (UID: \"4aab204f-103a-4267-94af-f175c1cbc0df\") " pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.845019 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.844987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdd9q\" (UniqueName: \"kubernetes.io/projected/ca29479a-4684-44ed-ab84-e83bb8676bab-kube-api-access-jdd9q\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:34.845322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.845187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bxf\" (UniqueName: \"kubernetes.io/projected/ad8a4f0f-06a0-454d-9fbe-bb1373a383e0-kube-api-access-76bxf\") pod \"console-operator-565b7b569d-2zslp\" (UID: \"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0\") " pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.846134 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.845839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-installation-pull-secrets\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.846134 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.846049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af52519d-6ccf-4525-b833-feabf84c514c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.848235 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.848061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqkwh\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-kube-api-access-gqkwh\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.848911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.848803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86kp\" (UniqueName: \"kubernetes.io/projected/28041f07-ca0f-4805-96c1-c23863f574a8-kube-api-access-s86kp\") pod \"volume-data-source-validator-78cf4c6f6-gbgp5\" (UID: \"28041f07-ca0f-4805-96c1-c23863f574a8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"
Jul 21 16:28:34.851796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01e09e9b-370f-4ad3-8865-745845519116-serving-cert\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.851796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms8l2\" (UniqueName: \"kubernetes.io/projected/708be621-6f4a-4a77-89b2-95fb2b98a435-kube-api-access-ms8l2\") pod \"kube-storage-version-migrator-operator-7658d9b749-gmjft\" (UID: \"708be621-6f4a-4a77-89b2-95fb2b98a435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:34.851796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmznl\" (UniqueName: \"kubernetes.io/projected/ff6d6bd9-9abb-4693-a65f-0cc455f79821-kube-api-access-rmznl\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.851796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-stats-auth\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:34.851796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-bound-sa-token\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:34.851796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgmq\" (UniqueName: \"kubernetes.io/projected/4aab204f-103a-4267-94af-f175c1cbc0df-kube-api-access-jxgmq\") pod \"ingress-canary-4kgw6\" (UID: \"4aab204f-103a-4267-94af-f175c1cbc0df\") " pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:34.852127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.851848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjmz\" (UniqueName: \"kubernetes.io/projected/af52519d-6ccf-4525-b833-feabf84c514c-kube-api-access-wwjmz\") pod \"service-ca-operator-5bcbc94c78-g4sm7\" (UID: \"af52519d-6ccf-4525-b833-feabf84c514c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:34.852127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.852094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrb7\" (UniqueName: \"kubernetes.io/projected/01e09e9b-370f-4ad3-8865-745845519116-kube-api-access-nkrb7\") pod \"insights-operator-555d9d7885-n7j2x\" (UID: \"01e09e9b-370f-4ad3-8865-745845519116\") " pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.854197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.854093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsz9k\" (UniqueName: \"kubernetes.io/projected/819d4b8d-220e-4731-a09f-8138b4ac316c-kube-api-access-dsz9k\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:34.897722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.897687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.936581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7pzm\" (UniqueName: \"kubernetes.io/projected/d45b949e-2f71-4424-861f-2800c30ab2d4-kube-api-access-b7pzm\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.936642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.936688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5ljd\" (UniqueName: \"kubernetes.io/projected/639d57ea-c490-4663-aefd-9f5f65e4d43a-kube-api-access-s5ljd\") pod \"network-check-source-7bc5b6bf85-lxfsf\" (UID: \"639d57ea-c490-4663-aefd-9f5f65e4d43a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.936713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92f64932-2fc7-4438-bc0e-6b8858c142c5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.936777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.936810    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.936881    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls podName:d45b949e-2f71-4424-861f-2800c30ab2d4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.436860653 +0000 UTC m=+37.704853308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vc454" (UID: "d45b949e-2f71-4424-861f-2800c30ab2d4") : secret "samples-operator-tls" not found
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.936912    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:28:34.936951 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:34.936959    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert podName:92f64932-2fc7-4438-bc0e-6b8858c142c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:35.436946117 +0000 UTC m=+37.704938803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vqn6q" (UID: "92f64932-2fc7-4438-bc0e-6b8858c142c5") : secret "networking-console-plugin-cert" not found
Jul 21 16:28:34.937610 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.937584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92f64932-2fc7-4438-bc0e-6b8858c142c5-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:34.946820 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.946790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5ljd\" (UniqueName: \"kubernetes.io/projected/639d57ea-c490-4663-aefd-9f5f65e4d43a-kube-api-access-s5ljd\") pod \"network-check-source-7bc5b6bf85-lxfsf\" (UID: \"639d57ea-c490-4663-aefd-9f5f65e4d43a\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"
Jul 21 16:28:34.946957 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.946831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7pzm\" (UniqueName: \"kubernetes.io/projected/d45b949e-2f71-4424-861f-2800c30ab2d4-kube-api-access-b7pzm\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:34.954547 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.954522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-n7j2x"
Jul 21 16:28:34.976115 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.976072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:34.992311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:34.992257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"
Jul 21 16:28:35.007450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.007410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"
Jul 21 16:28:35.015543 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.015511    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4kgw6"
Jul 21 16:28:35.023543 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.023515    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"
Jul 21 16:28:35.039986 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.039956    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"
Jul 21 16:28:35.239843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.239749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:28:35.242528 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.242506    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:28:35.341398 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.341360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:35.341585 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.341411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:35.341585 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341517    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:35.341585 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.341539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:35.341585 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341582    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls podName:819d4b8d-220e-4731-a09f-8138b4ac316c nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.341563495 +0000 UTC m=+38.609556164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v8q69" (UID: "819d4b8d-220e-4731-a09f-8138b4ac316c") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341611    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341521    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341641    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls podName:ca29479a-4684-44ed-ab84-e83bb8676bab nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.341632335 +0000 UTC m=+38.609625004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls") pod "dns-default-ps9h7" (UID: "ca29479a-4684-44ed-ab84-e83bb8676bab") : secret "dns-default-metrics-tls" not found
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341647    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f4d885b-qwn7m: secret "image-registry-tls" not found
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.341684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341720    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls podName:b059965e-ba61-4fa1-b8bb-891c9fc3a56a nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.34169536 +0000 UTC m=+38.609688030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls") pod "image-registry-775f4d885b-qwn7m" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a") : secret "image-registry-tls" not found
Jul 21 16:28:35.341773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341758    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.341740085 +0000 UTC m=+38.609732742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : configmap references non-existent config key: service-ca.crt
Jul 21 16:28:35.341992 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.341804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:35.341992 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341896    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:28:35.341992 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.341925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.341915505 +0000 UTC m=+38.609908174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : secret "router-metrics-certs-default" not found
Jul 21 16:28:35.431540 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.431445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:35.442453 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.442403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:35.442641 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.442505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:35.442641 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.442570    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:28:35.442750 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.442643    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls podName:d45b949e-2f71-4424-861f-2800c30ab2d4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.442626807 +0000 UTC m=+38.710619461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vc454" (UID: "d45b949e-2f71-4424-861f-2800c30ab2d4") : secret "samples-operator-tls" not found
Jul 21 16:28:35.442750 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.442651    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:28:35.442750 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:35.442709    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert podName:92f64932-2fc7-4438-bc0e-6b8858c142c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:36.442694151 +0000 UTC m=+38.710686819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vqn6q" (UID: "92f64932-2fc7-4438-bc0e-6b8858c142c5") : secret "networking-console-plugin-cert" not found
Jul 21 16:28:35.532773 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:35.532738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:36.239091 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.239056    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:28:36.239403 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.239366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:28:36.243117 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.243093    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:28:36.243467 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.243096    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlxp4\""
Jul 21 16:28:36.243467 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.243100    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnpg8\""
Jul 21 16:28:36.353595 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.353490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:36.353805 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.353617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:36.353805 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.353660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:36.353805 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.353709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:36.354000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.353850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:36.354065 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.354055    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.354033329 +0000 UTC m=+40.622025981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : configmap references non-existent config key: service-ca.crt
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.354441    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.354506    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.35448905 +0000 UTC m=+40.622481703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : secret "router-metrics-certs-default" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.354957    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.354974    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f4d885b-qwn7m: secret "image-registry-tls" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.355018    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls podName:b059965e-ba61-4fa1-b8bb-891c9fc3a56a nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.355002343 +0000 UTC m=+40.622994997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls") pod "image-registry-775f4d885b-qwn7m" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a") : secret "image-registry-tls" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.355091    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.355124    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls podName:819d4b8d-220e-4731-a09f-8138b4ac316c nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.35511362 +0000 UTC m=+40.623106272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v8q69" (UID: "819d4b8d-220e-4731-a09f-8138b4ac316c") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.355214    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:28:36.355475 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.355249    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls podName:ca29479a-4684-44ed-ab84-e83bb8676bab nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.355237192 +0000 UTC m=+40.623229847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls") pod "dns-default-ps9h7" (UID: "ca29479a-4684-44ed-ab84-e83bb8676bab") : secret "dns-default-metrics-tls" not found
Jul 21 16:28:36.456553 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.455332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:36.456553 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.455766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:36.456553 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.455949    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:28:36.456553 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.456019    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls podName:d45b949e-2f71-4424-861f-2800c30ab2d4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.455998248 +0000 UTC m=+40.723990922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vc454" (UID: "d45b949e-2f71-4424-861f-2800c30ab2d4") : secret "samples-operator-tls" not found
Jul 21 16:28:36.456553 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.456527    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:28:36.456914 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:36.456585    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert podName:92f64932-2fc7-4438-bc0e-6b8858c142c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:38.456567242 +0000 UTC m=+40.724559917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vqn6q" (UID: "92f64932-2fc7-4438-bc0e-6b8858c142c5") : secret "networking-console-plugin-cert" not found
Jul 21 16:28:36.600040 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.599895    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7"]
Jul 21 16:28:36.604157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.604109    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4kgw6"]
Jul 21 16:28:36.604157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.604214    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5"]
Jul 21 16:28:36.615193 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.615105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf"]
Jul 21 16:28:36.632100 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.632069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft"]
Jul 21 16:28:36.635565 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:36.635533    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708be621_6f4a_4a77_89b2_95fb2b98a435.slice/crio-3d654d0d9b399ec6f0cf6807e54ce5c1dd53633f704eaa5127c5c6332500a505 WatchSource:0}: Error finding container 3d654d0d9b399ec6f0cf6807e54ce5c1dd53633f704eaa5127c5c6332500a505: Status 404 returned error can't find the container with id 3d654d0d9b399ec6f0cf6807e54ce5c1dd53633f704eaa5127c5c6332500a505
Jul 21 16:28:36.640980 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.640953    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-n7j2x"]
Jul 21 16:28:36.644626 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:36.644585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e09e9b_370f_4ad3_8865_745845519116.slice/crio-85377cf872ff15fbb9d3ca39c937f7482654cce5e9ea3fdc449f465b211c0f37 WatchSource:0}: Error finding container 85377cf872ff15fbb9d3ca39c937f7482654cce5e9ea3fdc449f465b211c0f37: Status 404 returned error can't find the container with id 85377cf872ff15fbb9d3ca39c937f7482654cce5e9ea3fdc449f465b211c0f37
Jul 21 16:28:36.657151 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:36.657092    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2zslp"]
Jul 21 16:28:36.666207 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:36.666180    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8a4f0f_06a0_454d_9fbe_bb1373a383e0.slice/crio-a0449d93c614ba0259db04314ce7036386076e09400ff7b691b7a0af7c01bd69 WatchSource:0}: Error finding container a0449d93c614ba0259db04314ce7036386076e09400ff7b691b7a0af7c01bd69: Status 404 returned error can't find the container with id a0449d93c614ba0259db04314ce7036386076e09400ff7b691b7a0af7c01bd69
Jul 21 16:28:37.519047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.518996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7" event={"ID":"af52519d-6ccf-4525-b833-feabf84c514c","Type":"ContainerStarted","Data":"8691a8ce07474ed33724e0bc023feb697de0b3793fddb418ef122ef7f874e815"}
Jul 21 16:28:37.521595 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.521568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf" event={"ID":"639d57ea-c490-4663-aefd-9f5f65e4d43a","Type":"ContainerStarted","Data":"45b6827d39c09fffc6e2546fb6a9f2351507175a0e23925c2e71de62a11539d3"}
Jul 21 16:28:37.523473 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.523446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" event={"ID":"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0","Type":"ContainerStarted","Data":"a0449d93c614ba0259db04314ce7036386076e09400ff7b691b7a0af7c01bd69"}
Jul 21 16:28:37.525552 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.525524    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5" event={"ID":"28041f07-ca0f-4805-96c1-c23863f574a8","Type":"ContainerStarted","Data":"cdf5874f147495faaac883902f2d3b130df23eb785709df017abe03aabbfa9b3"}
Jul 21 16:28:37.530867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.530839    2575 generic.go:356] "Generic (PLEG): container finished" podID="7fb1e19a-cf5c-4c19-861c-fa81934b8727" containerID="ef37dedf3af189910d86622e7921d3ab7fb75da7574d50bd1f1aa11be1b6f89a" exitCode=0
Jul 21 16:28:37.530964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.530923    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerDied","Data":"ef37dedf3af189910d86622e7921d3ab7fb75da7574d50bd1f1aa11be1b6f89a"}
Jul 21 16:28:37.534031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.533976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-n7j2x" event={"ID":"01e09e9b-370f-4ad3-8865-745845519116","Type":"ContainerStarted","Data":"85377cf872ff15fbb9d3ca39c937f7482654cce5e9ea3fdc449f465b211c0f37"}
Jul 21 16:28:37.541670 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.541639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4kgw6" event={"ID":"4aab204f-103a-4267-94af-f175c1cbc0df","Type":"ContainerStarted","Data":"2face25f02c71cb947268d99ce55eabc8dc520bec18ba7a8a3997c9b27e361b1"}
Jul 21 16:28:37.549691 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.549633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft" event={"ID":"708be621-6f4a-4a77-89b2-95fb2b98a435","Type":"ContainerStarted","Data":"3d654d0d9b399ec6f0cf6807e54ce5c1dd53633f704eaa5127c5c6332500a505"}
Jul 21 16:28:37.777426 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.777290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:37.877997 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:37.877891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:38.312966 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.312796    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:38.369224 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.369178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.378124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.378209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.378275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.378302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.378339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.378504    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.378562    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls podName:ca29479a-4684-44ed-ab84-e83bb8676bab nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.378544081 +0000 UTC m=+44.646536738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls") pod "dns-default-ps9h7" (UID: "ca29479a-4684-44ed-ab84-e83bb8676bab") : secret "dns-default-metrics-tls" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.378957    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.378944833 +0000 UTC m=+44.646937485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : configmap references non-existent config key: service-ca.crt
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.379024    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.379056    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.379044808 +0000 UTC m=+44.647037475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : secret "router-metrics-certs-default" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.379119    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.379130    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f4d885b-qwn7m: secret "image-registry-tls" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.379160    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls podName:b059965e-ba61-4fa1-b8bb-891c9fc3a56a nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.379150067 +0000 UTC m=+44.647142734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls") pod "image-registry-775f4d885b-qwn7m" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a") : secret "image-registry-tls" not found
Jul 21 16:28:38.379293 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.379236    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:38.380140 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.380112    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls podName:819d4b8d-220e-4731-a09f-8138b4ac316c nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.380094569 +0000 UTC m=+44.648087226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v8q69" (UID: "819d4b8d-220e-4731-a09f-8138b4ac316c") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:38.478992 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.478948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:38.479207 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.479130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:38.479335 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.479318    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:28:38.479408 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.479392    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls podName:d45b949e-2f71-4424-861f-2800c30ab2d4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.479370362 +0000 UTC m=+44.747363036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vc454" (UID: "d45b949e-2f71-4424-861f-2800c30ab2d4") : secret "samples-operator-tls" not found
Jul 21 16:28:38.479842 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.479820    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:28:38.479943 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:38.479886    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert podName:92f64932-2fc7-4438-bc0e-6b8858c142c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:42.479867053 +0000 UTC m=+44.747859730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vqn6q" (UID: "92f64932-2fc7-4438-bc0e-6b8858c142c5") : secret "networking-console-plugin-cert" not found
Jul 21 16:28:38.560197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.559944    2575 generic.go:356] "Generic (PLEG): container finished" podID="7fb1e19a-cf5c-4c19-861c-fa81934b8727" containerID="bbc2e81b4a3ef512cdd000100f46b4af51e0fbf5ce2ffe79e82060d40ee7ca36" exitCode=0
Jul 21 16:28:38.560197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:38.560004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerDied","Data":"bbc2e81b4a3ef512cdd000100f46b4af51e0fbf5ce2ffe79e82060d40ee7ca36"}
Jul 21 16:28:42.419414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.419374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.419451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.419507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.419528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.419559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419631    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.419601048 +0000 UTC m=+52.687593713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : configmap references non-existent config key: service-ca.crt
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419630    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419682    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.419671151 +0000 UTC m=+52.687663803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : secret "router-metrics-certs-default" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419705    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419719    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f4d885b-qwn7m: secret "image-registry-tls" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419760    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls podName:b059965e-ba61-4fa1-b8bb-891c9fc3a56a nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.419743429 +0000 UTC m=+52.687736087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls") pod "image-registry-775f4d885b-qwn7m" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a") : secret "image-registry-tls" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419719    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419796    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls podName:ca29479a-4684-44ed-ab84-e83bb8676bab nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.419788726 +0000 UTC m=+52.687781384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls") pod "dns-default-ps9h7" (UID: "ca29479a-4684-44ed-ab84-e83bb8676bab") : secret "dns-default-metrics-tls" not found
Jul 21 16:28:42.419853 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419797    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:42.420445 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.419912    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls podName:819d4b8d-220e-4731-a09f-8138b4ac316c nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.419894238 +0000 UTC m=+52.687886891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v8q69" (UID: "819d4b8d-220e-4731-a09f-8138b4ac316c") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:42.520870 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.520832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:42.521089 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:42.521010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:42.521089 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.521025    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:28:42.521231 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.521102    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert podName:92f64932-2fc7-4438-bc0e-6b8858c142c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.521077986 +0000 UTC m=+52.789070656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vqn6q" (UID: "92f64932-2fc7-4438-bc0e-6b8858c142c5") : secret "networking-console-plugin-cert" not found
Jul 21 16:28:42.521231 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.521143    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 16:28:42.521231 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:42.521221    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls podName:d45b949e-2f71-4424-861f-2800c30ab2d4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:50.521205358 +0000 UTC m=+52.789198031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vc454" (UID: "d45b949e-2f71-4424-861f-2800c30ab2d4") : secret "samples-operator-tls" not found
Jul 21 16:28:43.370341 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:43.370201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:43.470631 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:43.470595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:43.571720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:43.571674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.403697 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.403660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.459102 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.459061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:44.576965 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.576931    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4kgw6" event={"ID":"4aab204f-103a-4267-94af-f175c1cbc0df","Type":"ContainerStarted","Data":"2816e7ced854173fb686d5a9954dacf2161b83f73e3e49391f277437281b3df1"}
Jul 21 16:28:44.578959 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.578923    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" event={"ID":"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0","Type":"ContainerStarted","Data":"656377733e864d83d2a0f8db69aee5d6409d832692de2a4547ab28562fe99a89"}
Jul 21 16:28:44.579071 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.578976    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:44.580639 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.580570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5" event={"ID":"28041f07-ca0f-4805-96c1-c23863f574a8","Type":"ContainerStarted","Data":"e92f49de27608a0d6bcbee57ba905c34a0123b7e2273db16541fdf5b81c0ea21"}
Jul 21 16:28:44.580729 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.580677    2575 patch_prober.go:28] interesting pod/console-operator-565b7b569d-2zslp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body=
Jul 21 16:28:44.580784 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.580720    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podUID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused"
Jul 21 16:28:44.584111 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.584093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" event={"ID":"7fb1e19a-cf5c-4c19-861c-fa81934b8727","Type":"ContainerStarted","Data":"f6a06df634dd60b6cf6e7fb97bc7cc1e71b3878f0136515f0fc115df8222b052"}
Jul 21 16:28:44.595018 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.594973    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4kgw6" podStartSLOduration=2.842829321 podStartE2EDuration="10.594959826s" totalImagesPullingTime="7.752130505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:44.593822225 +0000 UTC m=+46.861814900" watchObservedRunningTime="2026-07-21 16:28:44.594959826 +0000 UTC m=+46.862952478"
Jul 21 16:28:44.616549 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.616381    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4fhjx" podStartSLOduration=14.691432773 podStartE2EDuration="46.616356915s" totalImagesPullingTime="31.924924142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:44.614972217 +0000 UTC m=+46.882964891" watchObservedRunningTime="2026-07-21 16:28:44.616356915 +0000 UTC m=+46.884349589"
Jul 21 16:28:44.648584 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.648531    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podStartSLOduration=31.941643542 podStartE2EDuration="39.648512951s" totalImagesPullingTime="7.706869409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:44.633059244 +0000 UTC m=+46.901051921" watchObservedRunningTime="2026-07-21 16:28:44.648512951 +0000 UTC m=+46.916505625"
Jul 21 16:28:44.977552 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.977507    2575 patch_prober.go:28] interesting pod/console-operator-565b7b569d-2zslp container/console-operator namespace/openshift-console-operator: Liveness probe status=failure output="Get \"https://10.132.0.9:8443/healthz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body=
Jul 21 16:28:44.977739 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:44.977582    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podUID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/healthz\": dial tcp 10.132.0.9:8443: connect: connection refused"
Jul 21 16:28:45.013657 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.013621    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.180964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.180874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.358995 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.358963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:45.590594 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.590554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7" event={"ID":"af52519d-6ccf-4525-b833-feabf84c514c","Type":"ContainerStarted","Data":"d24a416e6fa6aef0b63cc72abe81bc0e1d03efe5757277f2025ef8959e9f5d63"}
Jul 21 16:28:45.592333 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.592301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf" event={"ID":"639d57ea-c490-4663-aefd-9f5f65e4d43a","Type":"ContainerStarted","Data":"0335037ed9a7dc4213304fd3af3bd72bec96009a160e2d9e795308c017a3fbc1"}
Jul 21 16:28:45.593960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.593938    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/0.log"
Jul 21 16:28:45.594120 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.594103    2575 generic.go:356] "Generic (PLEG): container finished" podID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0" containerID="656377733e864d83d2a0f8db69aee5d6409d832692de2a4547ab28562fe99a89" exitCode=255
Jul 21 16:28:45.594323 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.594306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" event={"ID":"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0","Type":"ContainerDied","Data":"656377733e864d83d2a0f8db69aee5d6409d832692de2a4547ab28562fe99a89"}
Jul 21 16:28:45.594568 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.594553    2575 scope.go:117] "RemoveContainer" containerID="656377733e864d83d2a0f8db69aee5d6409d832692de2a4547ab28562fe99a89"
Jul 21 16:28:45.596364 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.596339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-n7j2x" event={"ID":"01e09e9b-370f-4ad3-8865-745845519116","Type":"ContainerStarted","Data":"85e131bfac6ff505b03dffbb9a7ea2fa6f59417e663858a36b8a33460976c97c"}
Jul 21 16:28:45.598326 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.598305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft" event={"ID":"708be621-6f4a-4a77-89b2-95fb2b98a435","Type":"ContainerStarted","Data":"c2d647ee6f3198c218a0949c295c356343969b9ce6e0656acf80127692efe5e4"}
Jul 21 16:28:45.608967 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.608925    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gbgp5" podStartSLOduration=32.885590531 podStartE2EDuration="40.608906447s" totalImagesPullingTime="7.723315916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:44.647952131 +0000 UTC m=+46.915944804" watchObservedRunningTime="2026-07-21 16:28:45.608906447 +0000 UTC m=+47.876899122"
Jul 21 16:28:45.609108 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.609014    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7" podStartSLOduration=32.854650529 podStartE2EDuration="40.609008028s" totalImagesPullingTime="7.754357499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:45.6077517 +0000 UTC m=+47.875744376" watchObservedRunningTime="2026-07-21 16:28:45.609008028 +0000 UTC m=+47.877000704"
Jul 21 16:28:45.625297 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.625241    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lxfsf" podStartSLOduration=32.525789454 podStartE2EDuration="40.625219557s" totalImagesPullingTime="8.099430103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:45.624706633 +0000 UTC m=+47.892699331" watchObservedRunningTime="2026-07-21 16:28:45.625219557 +0000 UTC m=+47.893212232"
Jul 21 16:28:45.641686 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.641631    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft" podStartSLOduration=32.904650289 podStartE2EDuration="40.6416148s" totalImagesPullingTime="7.736964511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:45.641483106 +0000 UTC m=+47.909475782" watchObservedRunningTime="2026-07-21 16:28:45.6416148 +0000 UTC m=+47.909607474"
Jul 21 16:28:45.660935 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:45.660871    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-n7j2x" podStartSLOduration=32.92448068 podStartE2EDuration="40.660853604s" totalImagesPullingTime="7.736372924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:45.659406569 +0000 UTC m=+47.927399319" watchObservedRunningTime="2026-07-21 16:28:45.660853604 +0000 UTC m=+47.928846290"
Jul 21 16:28:46.067195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.066495    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p6clr"]
Jul 21 16:28:46.082547 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.082514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p6clr"]
Jul 21 16:28:46.082745 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.082620    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.085237 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.085214    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 16:28:46.085578 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.085272    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 16:28:46.085861 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.085364    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d444m\""
Jul 21 16:28:46.102562 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.102530    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.160478 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.160440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.160659 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.160597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81934a32-6460-4a08-b572-9b0602ebb0f4-crio-socket\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.160659 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.160642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81934a32-6460-4a08-b572-9b0602ebb0f4-data-volume\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.160761 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.160687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fxbk\" (UniqueName: \"kubernetes.io/projected/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-api-access-8fxbk\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.160761 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.160736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.163637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.163611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.262034 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.261994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.262093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81934a32-6460-4a08-b572-9b0602ebb0f4-crio-socket\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262227 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.262123    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:46.262227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.262126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81934a32-6460-4a08-b572-9b0602ebb0f4-data-volume\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262227 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.262209    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:46.762187748 +0000 UTC m=+49.030180400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:46.262486 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.262283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fxbk\" (UniqueName: \"kubernetes.io/projected/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-api-access-8fxbk\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262486 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.262340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262486 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.262348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81934a32-6460-4a08-b572-9b0602ebb0f4-crio-socket\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262486 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.262443    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:46.262486 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.262467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81934a32-6460-4a08-b572-9b0602ebb0f4-data-volume\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.262486 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.262489    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:46.762472097 +0000 UTC m=+49.030464749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:46.273138 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.273102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fxbk\" (UniqueName: \"kubernetes.io/projected/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-api-access-8fxbk\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.364891 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.364800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.399965 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.399932    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"]
Jul 21 16:28:46.422339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.422297    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"]
Jul 21 16:28:46.422515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.422364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"
Jul 21 16:28:46.424704 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.424679    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:46.424927 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.424904    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n24ln\""
Jul 21 16:28:46.425344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.425323    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 16:28:46.440199 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.440151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.464515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.464483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglb9\" (UniqueName: \"kubernetes.io/projected/bf01c60c-b30a-4e40-a66f-0aeb994d311f-kube-api-access-zglb9\") pod \"migrator-7cc9c7ffd7-dqr7v\" (UID: \"bf01c60c-b30a-4e40-a66f-0aeb994d311f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"
Jul 21 16:28:46.497188 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.497138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.566236 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.566196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglb9\" (UniqueName: \"kubernetes.io/projected/bf01c60c-b30a-4e40-a66f-0aeb994d311f-kube-api-access-zglb9\") pod \"migrator-7cc9c7ffd7-dqr7v\" (UID: \"bf01c60c-b30a-4e40-a66f-0aeb994d311f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"
Jul 21 16:28:46.575178 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.575134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglb9\" (UniqueName: \"kubernetes.io/projected/bf01c60c-b30a-4e40-a66f-0aeb994d311f-kube-api-access-zglb9\") pod \"migrator-7cc9c7ffd7-dqr7v\" (UID: \"bf01c60c-b30a-4e40-a66f-0aeb994d311f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"
Jul 21 16:28:46.605346 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.605315    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:28:46.605858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.605839    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/0.log"
Jul 21 16:28:46.605916 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.605886    2575 generic.go:356] "Generic (PLEG): container finished" podID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0" containerID="81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb" exitCode=255
Jul 21 16:28:46.606022 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.606000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" event={"ID":"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0","Type":"ContainerDied","Data":"81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb"}
Jul 21 16:28:46.606078 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.606062    2575 scope.go:117] "RemoveContainer" containerID="656377733e864d83d2a0f8db69aee5d6409d832692de2a4547ab28562fe99a89"
Jul 21 16:28:46.606233 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.606215    2575 scope.go:117] "RemoveContainer" containerID="81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb"
Jul 21 16:28:46.606460 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.606432    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2zslp_openshift-console-operator(ad8a4f0f-06a0-454d-9fbe-bb1373a383e0)\"" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podUID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0"
Jul 21 16:28:46.732918 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.732886    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"
Jul 21 16:28:46.769731 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.769694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.769928 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.769829    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:46.769928 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.769877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:46.769928 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.769901    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:47.769883011 +0000 UTC m=+50.037875682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:46.770098 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.769978    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:46.770098 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:46.770038    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:47.770021482 +0000 UTC m=+50.038014137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:46.883823 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.883725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v"]
Jul 21 16:28:46.884598 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.884478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:46.887263 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:46.887226    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf01c60c_b30a_4e40_a66f_0aeb994d311f.slice/crio-89c3a71b9d5416b5cf7453977a4426cf28f9b56931a9c0d2ce8e3b296bd79df6 WatchSource:0}: Error finding container 89c3a71b9d5416b5cf7453977a4426cf28f9b56931a9c0d2ce8e3b296bd79df6: Status 404 returned error can't find the container with id 89c3a71b9d5416b5cf7453977a4426cf28f9b56931a9c0d2ce8e3b296bd79df6
Jul 21 16:28:46.980350 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:46.980314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.057622 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.057597    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7t5gx_82fd1bab-16d3-4a93-b99d-6cd2c790ce4c/dns-node-resolver/0.log"
Jul 21 16:28:47.167020 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.166928    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.225355 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.225323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:47.611757 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.611730    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:28:47.612227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.612074    2575 scope.go:117] "RemoveContainer" containerID="81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb"
Jul 21 16:28:47.612322 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:47.612302    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2zslp_openshift-console-operator(ad8a4f0f-06a0-454d-9fbe-bb1373a383e0)\"" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podUID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0"
Jul 21 16:28:47.613002 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.612979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v" event={"ID":"bf01c60c-b30a-4e40-a66f-0aeb994d311f","Type":"ContainerStarted","Data":"89c3a71b9d5416b5cf7453977a4426cf28f9b56931a9c0d2ce8e3b296bd79df6"}
Jul 21 16:28:47.779774 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.779730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:47.779977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:47.779820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:47.779977 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:47.779875    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:47.779977 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:47.779888    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:47.779977 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:47.779943    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:49.779927306 +0000 UTC m=+52.047919958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:47.779977 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:47.779957    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:49.779951153 +0000 UTC m=+52.047943805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:48.058231 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.058204    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6nn9_4d5760a6-59bf-4b99-bf09-c3834f29411c/node-ca/0.log"
Jul 21 16:28:48.263300 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.263265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:48.330524 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.330436    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:48.762752 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.762721    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-thmq5"]
Jul 21 16:28:48.791043 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.791004    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-thmq5"]
Jul 21 16:28:48.791244 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.791121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.793811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.793782    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gmr4s\""
Jul 21 16:28:48.793811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.793809    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 16:28:48.793987 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.793811    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 16:28:48.794621 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.794597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 16:28:48.794621 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.794610    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 16:28:48.808528 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.808494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:48.858232 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.858144    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4kgw6_4aab204f-103a-4267-94af-f175c1cbc0df/serve-healthcheck-canary/0.log"
Jul 21 16:28:48.890382 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.890349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a927a162-511a-42e0-bb60-29711db61ab8-signing-key\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.890573 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.890443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnrf\" (UniqueName: \"kubernetes.io/projected/a927a162-511a-42e0-bb60-29711db61ab8-kube-api-access-bpnrf\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.890573 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.890476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a927a162-511a-42e0-bb60-29711db61ab8-signing-cabundle\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.908611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.908576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:48.991615 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.991580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a927a162-511a-42e0-bb60-29711db61ab8-signing-key\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.991789 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.991675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnrf\" (UniqueName: \"kubernetes.io/projected/a927a162-511a-42e0-bb60-29711db61ab8-kube-api-access-bpnrf\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.991789 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.991704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a927a162-511a-42e0-bb60-29711db61ab8-signing-cabundle\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.992386 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.992367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a927a162-511a-42e0-bb60-29711db61ab8-signing-cabundle\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:48.994144 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:48.994124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a927a162-511a-42e0-bb60-29711db61ab8-signing-key\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:49.000747 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.000726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnrf\" (UniqueName: \"kubernetes.io/projected/a927a162-511a-42e0-bb60-29711db61ab8-kube-api-access-bpnrf\") pod \"service-ca-58598695f7-thmq5\" (UID: \"a927a162-511a-42e0-bb60-29711db61ab8\") " pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:49.100298 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.100261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-thmq5"
Jul 21 16:28:49.227515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.227484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.252389 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.252334    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-thmq5"]
Jul 21 16:28:49.254766 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:28:49.254745    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda927a162_511a_42e0_bb60_29711db61ab8.slice/crio-add74782a1e4644b4295d117d9f1fd0eb2d320c391255cd6a3d813a920b47f25 WatchSource:0}: Error finding container add74782a1e4644b4295d117d9f1fd0eb2d320c391255cd6a3d813a920b47f25: Status 404 returned error can't find the container with id add74782a1e4644b4295d117d9f1fd0eb2d320c391255cd6a3d813a920b47f25
Jul 21 16:28:49.325471 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.325439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.401143 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.401106    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.624072 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.624034    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v" event={"ID":"bf01c60c-b30a-4e40-a66f-0aeb994d311f","Type":"ContainerStarted","Data":"34bd54ad2926c78b2303eba1e1980f060d821b2ffc175a6064c57e4f4c21626a"}
Jul 21 16:28:49.624300 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.624098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v" event={"ID":"bf01c60c-b30a-4e40-a66f-0aeb994d311f","Type":"ContainerStarted","Data":"129871d890689d26bad890d8d0e20b071db5028e2e4818ad4609df41e0da4e59"}
Jul 21 16:28:49.625475 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.625448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-thmq5" event={"ID":"a927a162-511a-42e0-bb60-29711db61ab8","Type":"ContainerStarted","Data":"a3d7b21ead3f82fa2bf1b8c2f327e2b8dadfc0026d89a6422284867dca84eda1"}
Jul 21 16:28:49.625604 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.625487    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-thmq5" event={"ID":"a927a162-511a-42e0-bb60-29711db61ab8","Type":"ContainerStarted","Data":"add74782a1e4644b4295d117d9f1fd0eb2d320c391255cd6a3d813a920b47f25"}
Jul 21 16:28:49.640123 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.640029    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dqr7v" podStartSLOduration=1.9608539189999998 podStartE2EDuration="3.640011404s" totalImagesPullingTime="1.679157485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:49.638666625 +0000 UTC m=+51.906659299" watchObservedRunningTime="2026-07-21 16:28:49.640011404 +0000 UTC m=+51.908004078"
Jul 21 16:28:49.653357 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.653251    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-thmq5" podStartSLOduration=1.653232092 podStartE2EDuration="1.653232092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:49.652621872 +0000 UTC m=+51.920614547" watchObservedRunningTime="2026-07-21 16:28:49.653232092 +0000 UTC m=+51.921224767"
Jul 21 16:28:49.692866 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.692836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:49.800115 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.800072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:49.800628 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:49.800184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:49.800628 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:49.800254    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:28:49.800628 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:49.800277    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:49.800628 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:49.800309    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:53.800294011 +0000 UTC m=+56.068286663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : configmap "kube-rbac-proxy" not found
Jul 21 16:28:49.800628 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:49.800331    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:53.80031533 +0000 UTC m=+56.068307983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:50.154611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.154576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:50.321793 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.321746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:50.507119 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.507084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:50.507352 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.507157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:28:50.507352 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.507246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:28:50.507352 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.507273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:28:50.507352 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.507307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:28:50.507572 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507477    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:28:50.507572 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507536    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls podName:ca29479a-4684-44ed-ab84-e83bb8676bab nodeName:}" failed. No retries permitted until 2026-07-21 16:29:06.507517016 +0000 UTC m=+68.775509674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls") pod "dns-default-ps9h7" (UID: "ca29479a-4684-44ed-ab84-e83bb8676bab") : secret "dns-default-metrics-tls" not found
Jul 21 16:28:50.507812 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507794    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:28:50.507912 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507903    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f4d885b-qwn7m: secret "image-registry-tls" not found
Jul 21 16:28:50.508005 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507984    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:06.507965648 +0000 UTC m=+68.775958307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : configmap references non-existent config key: service-ca.crt
Jul 21 16:28:50.508005 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.508019    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls podName:b059965e-ba61-4fa1-b8bb-891c9fc3a56a nodeName:}" failed. No retries permitted until 2026-07-21 16:29:06.508001139 +0000 UTC m=+68.775993795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls") pod "image-registry-775f4d885b-qwn7m" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a") : secret "image-registry-tls" not found
Jul 21 16:28:50.508005 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507804    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:50.508320 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.508059    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls podName:819d4b8d-220e-4731-a09f-8138b4ac316c nodeName:}" failed. No retries permitted until 2026-07-21 16:29:06.508048438 +0000 UTC m=+68.776041093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v8q69" (UID: "819d4b8d-220e-4731-a09f-8138b4ac316c") : secret "cluster-monitoring-operator-tls" not found
Jul 21 16:28:50.508320 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.507861    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 16:28:50.508320 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.508097    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs podName:ff6d6bd9-9abb-4693-a65f-0cc455f79821 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:06.508089458 +0000 UTC m=+68.776082115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs") pod "router-default-58b59cb77b-zj22b" (UID: "ff6d6bd9-9abb-4693-a65f-0cc455f79821") : secret "router-metrics-certs-default" not found
Jul 21 16:28:50.521526 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.521434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:50.608857 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.608761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:28:50.608857 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.608795    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 16:28:50.609079 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:50.608887    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert podName:92f64932-2fc7-4438-bc0e-6b8858c142c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:06.608866953 +0000 UTC m=+68.876859621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-vqn6q" (UID: "92f64932-2fc7-4438-bc0e-6b8858c142c5") : secret "networking-console-plugin-cert" not found
Jul 21 16:28:50.609459 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.609437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:50.619757 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.619729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d45b949e-2f71-4424-861f-2800c30ab2d4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vc454\" (UID: \"d45b949e-2f71-4424-861f-2800c30ab2d4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:50.621452 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.621424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:50.633795 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.633766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"
Jul 21 16:28:50.724920 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.724846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:50.843718 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:50.843557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454"]
Jul 21 16:28:51.021137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:51.021097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:51.633765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:51.633720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454" event={"ID":"d45b949e-2f71-4424-861f-2800c30ab2d4","Type":"ContainerStarted","Data":"a096d8d3472b1c9b0c9e75f28d3101f741a417f3acbe5a2f6be41d2f5c95c889"}
Jul 21 16:28:52.193367 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:52.193269    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:52.257577 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:52.257539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:52.610505 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:52.610465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:52.765786 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:52.765743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:52.886300 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:52.886143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:53.219271 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.219155    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:53.284607 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.284551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:53.643632 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.643597    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454" event={"ID":"d45b949e-2f71-4424-861f-2800c30ab2d4","Type":"ContainerStarted","Data":"044ed1a5a9332330fb4c5c016a341a728d020f0bb8492793d7d0bacd97aa3096"}
Jul 21 16:28:53.643770 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.643652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454" event={"ID":"d45b949e-2f71-4424-861f-2800c30ab2d4","Type":"ContainerStarted","Data":"b44500f680857336e97d0ef309d991cbb6224ee1582e9248fd2464fe78d4944d"}
Jul 21 16:28:53.663828 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.663763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vc454" podStartSLOduration=46.243430952 podStartE2EDuration="48.663744852s" totalImagesPullingTime="2.4203139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:53.662497017 +0000 UTC m=+55.930489691" watchObservedRunningTime="2026-07-21 16:28:53.663744852 +0000 UTC m=+55.931737516"
Jul 21 16:28:53.834988 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.834950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:53.840997 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.840972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:53.841147 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.841059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:53.841147 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:53.841112    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:53.841273 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:53.841196    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls podName:81934a32-6460-4a08-b572-9b0602ebb0f4 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:01.841156521 +0000 UTC m=+64.109149175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6clr" (UID: "81934a32-6460-4a08-b572-9b0602ebb0f4") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:28:53.841612 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:53.841590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81934a32-6460-4a08-b572-9b0602ebb0f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:28:54.012364 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.012332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:54.126192 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.126082    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:54.421044 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.420954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:54.579221 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.579192    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:54.579590 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.579576    2575 scope.go:117] "RemoveContainer" containerID="81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb"
Jul 21 16:28:54.579743 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:54.579725    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2zslp_openshift-console-operator(ad8a4f0f-06a0-454d-9fbe-bb1373a383e0)\"" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podUID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0"
Jul 21 16:28:54.623919 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.623884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:54.817283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.817248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:54.872515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.872478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:54.976977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.976941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:28:54.977339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:54.977326    2575 scope.go:117] "RemoveContainer" containerID="81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb"
Jul 21 16:28:54.977494 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:28:54.977475    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2zslp_openshift-console-operator(ad8a4f0f-06a0-454d-9fbe-bb1373a383e0)\"" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" podUID="ad8a4f0f-06a0-454d-9fbe-bb1373a383e0"
Jul 21 16:28:55.228236 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:55.228144    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:55.818899 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:55.818862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:56.418991 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:56.418961    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:56.608298 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:56.608260    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:56.659753 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:56.659711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:56.811510 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:56.811478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:57.015847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:57.015817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:58.217796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:58.217761    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:58.415808 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:58.415771    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:58.917654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:58.917614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:59.021085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:59.021054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:59.090472 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:28:59.090442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:00.014083 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.014044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:00.172620 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.172586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:00.274005 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.273911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:00.411643 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.411606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:00.511350 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.511324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnjx"
Jul 21 16:29:00.615631 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.615539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:00.814616 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:00.814571    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:01.012841 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:01.012812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:01.619846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:01.619809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:01.917615 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:01.917506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:29:01.920034 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:01.920002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81934a32-6460-4a08-b572-9b0602ebb0f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6clr\" (UID: \"81934a32-6460-4a08-b572-9b0602ebb0f4\") " pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:29:01.996755 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:01.996723    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d444m\""
Jul 21 16:29:02.004411 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:02.004379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p6clr"
Jul 21 16:29:02.138973 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:02.138943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p6clr"]
Jul 21 16:29:02.142090 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:02.142063    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81934a32_6460_4a08_b572_9b0602ebb0f4.slice/crio-ba0e737cfa8536e2faff27c37318f10474361881829a3d7b9cf085f7af054de5 WatchSource:0}: Error finding container ba0e737cfa8536e2faff27c37318f10474361881829a3d7b9cf085f7af054de5: Status 404 returned error can't find the container with id ba0e737cfa8536e2faff27c37318f10474361881829a3d7b9cf085f7af054de5
Jul 21 16:29:02.676748 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:02.676704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6clr" event={"ID":"81934a32-6460-4a08-b572-9b0602ebb0f4","Type":"ContainerStarted","Data":"ba0e737cfa8536e2faff27c37318f10474361881829a3d7b9cf085f7af054de5"}
Jul 21 16:29:03.939077 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:03.939033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:29:03.939598 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:03.939155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:29:03.941690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:03.941652    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:29:03.942442 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:03.942423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktbh\" (UniqueName: \"kubernetes.io/projected/1778ec64-ca10-4871-877a-f82178097e18-kube-api-access-dktbh\") pod \"network-check-target-jfhlt\" (UID: \"1778ec64-ca10-4871-877a-f82178097e18\") " pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:29:03.952400 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:03.952373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00314b86-e6f3-4785-9870-ace7beeb1caa-metrics-certs\") pod \"network-metrics-daemon-wnthg\" (UID: \"00314b86-e6f3-4785-9870-ace7beeb1caa\") " pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:29:04.039919 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.039882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:29:04.042571 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.042535    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:29:04.053348 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.053317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52c5b102-a3da-43a7-867e-d143f298e61b-original-pull-secret\") pod \"global-pull-secret-syncer-5vdds\" (UID: \"52c5b102-a3da-43a7-867e-d143f298e61b\") " pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:29:04.153847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.153813    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlxp4\""
Jul 21 16:29:04.160784 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.160746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnpg8\""
Jul 21 16:29:04.161762 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.161732    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnthg"
Jul 21 16:29:04.169717 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.169626    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:29:04.328958 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.328916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnthg"]
Jul 21 16:29:04.332059 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:04.332025    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00314b86_e6f3_4785_9870_ace7beeb1caa.slice/crio-ee157a4913cec8e110d7c7067fdac54d8d1f8404bea0516a034201ff35da7e2e WatchSource:0}: Error finding container ee157a4913cec8e110d7c7067fdac54d8d1f8404bea0516a034201ff35da7e2e: Status 404 returned error can't find the container with id ee157a4913cec8e110d7c7067fdac54d8d1f8404bea0516a034201ff35da7e2e
Jul 21 16:29:04.345204 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.345149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfhlt"]
Jul 21 16:29:04.348874 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:04.348838    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1778ec64_ca10_4871_877a_f82178097e18.slice/crio-dbd8b99f301736f656781a755c314b96116b7a4bcaf25346bc164c09a012cc89 WatchSource:0}: Error finding container dbd8b99f301736f656781a755c314b96116b7a4bcaf25346bc164c09a012cc89: Status 404 returned error can't find the container with id dbd8b99f301736f656781a755c314b96116b7a4bcaf25346bc164c09a012cc89
Jul 21 16:29:04.350706 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.350551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vdds"
Jul 21 16:29:04.505632 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.505586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vdds"]
Jul 21 16:29:04.687788 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.687750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfhlt" event={"ID":"1778ec64-ca10-4871-877a-f82178097e18","Type":"ContainerStarted","Data":"bac4fe09bd3bf945cbddf945e8351efe875be1071c6d0db0bec8351b9396deac"}
Jul 21 16:29:04.688000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.687814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfhlt" event={"ID":"1778ec64-ca10-4871-877a-f82178097e18","Type":"ContainerStarted","Data":"dbd8b99f301736f656781a755c314b96116b7a4bcaf25346bc164c09a012cc89"}
Jul 21 16:29:04.688000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.687839    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:29:04.689706 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.689679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnthg" event={"ID":"00314b86-e6f3-4785-9870-ace7beeb1caa","Type":"ContainerStarted","Data":"ee157a4913cec8e110d7c7067fdac54d8d1f8404bea0516a034201ff35da7e2e"}
Jul 21 16:29:04.702515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:04.702433    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfhlt" podStartSLOduration=66.702416827 podStartE2EDuration="1m6.702416827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:04.702062372 +0000 UTC m=+66.970055050" watchObservedRunningTime="2026-07-21 16:29:04.702416827 +0000 UTC m=+66.970409501"
Jul 21 16:29:06.239482 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.239450    2575 scope.go:117] "RemoveContainer" containerID="81225c300c08e7fff694ce24746421a5d89c7d268cf5305fb1ee8d96ca2676eb"
Jul 21 16:29:06.564574 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.564530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:06.564574 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.564578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:29:06.564799 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.564600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:29:06.564799 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.564640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:06.564799 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.564667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:06.565392 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.565363    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6d6bd9-9abb-4693-a65f-0cc455f79821-service-ca-bundle\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:06.567210 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.567184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff6d6bd9-9abb-4693-a65f-0cc455f79821-metrics-certs\") pod \"router-default-58b59cb77b-zj22b\" (UID: \"ff6d6bd9-9abb-4693-a65f-0cc455f79821\") " pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:06.567302 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.567247    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/819d4b8d-220e-4731-a09f-8138b4ac316c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v8q69\" (UID: \"819d4b8d-220e-4731-a09f-8138b4ac316c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:29:06.567415 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.567399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca29479a-4684-44ed-ab84-e83bb8676bab-metrics-tls\") pod \"dns-default-ps9h7\" (UID: \"ca29479a-4684-44ed-ab84-e83bb8676bab\") " pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:29:06.567489 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.567474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"image-registry-775f4d885b-qwn7m\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") " pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:06.665945 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.665908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:29:06.668482 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.668450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92f64932-2fc7-4438-bc0e-6b8858c142c5-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-vqn6q\" (UID: \"92f64932-2fc7-4438-bc0e-6b8858c142c5\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:29:06.715118 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:06.715072    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c5b102_a3da_43a7_867e_d143f298e61b.slice/crio-50ae71eced9c3d60f6f5367c0bf1ef118860e1213957b7663f3fc96ab79796b5 WatchSource:0}: Error finding container 50ae71eced9c3d60f6f5367c0bf1ef118860e1213957b7663f3fc96ab79796b5: Status 404 returned error can't find the container with id 50ae71eced9c3d60f6f5367c0bf1ef118860e1213957b7663f3fc96ab79796b5
Jul 21 16:29:06.740086 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.740050    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9vz5j\""
Jul 21 16:29:06.748246 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.748205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:06.768995 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.768961    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zkh7z\""
Jul 21 16:29:06.776883 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.776858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:06.786407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.786364    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nxpnx\""
Jul 21 16:29:06.794518 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.794478    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"
Jul 21 16:29:06.802825 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.802798    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fjqx\""
Jul 21 16:29:06.810864 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.810836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:29:06.847405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.847372    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-89xjl\""
Jul 21 16:29:06.855557 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:06.855525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"
Jul 21 16:29:07.752408 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.752120    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:29:07.752408 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.752285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2zslp" event={"ID":"ad8a4f0f-06a0-454d-9fbe-bb1373a383e0","Type":"ContainerStarted","Data":"09c5ffea5c0c570a828ed4560eb92d3670584f6ea62fee51adda0cf7ffb32968"}
Jul 21 16:29:07.755904 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.755636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vdds" event={"ID":"52c5b102-a3da-43a7-867e-d143f298e61b","Type":"ContainerStarted","Data":"50ae71eced9c3d60f6f5367c0bf1ef118860e1213957b7663f3fc96ab79796b5"}
Jul 21 16:29:07.767315 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.767275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:07.814264 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.810762    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q"]
Jul 21 16:29:07.814264 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.813692    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775f4d885b-qwn7m"]
Jul 21 16:29:07.830614 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:07.830469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:08.044515 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:08.037267    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb059965e_ba61_4fa1_b8bb_891c9fc3a56a.slice/crio-8a11f9c3746975f25bd48f33d2e3f80bb3631c7481dfa66780c1fc86011924dc WatchSource:0}: Error finding container 8a11f9c3746975f25bd48f33d2e3f80bb3631c7481dfa66780c1fc86011924dc: Status 404 returned error can't find the container with id 8a11f9c3746975f25bd48f33d2e3f80bb3631c7481dfa66780c1fc86011924dc
Jul 21 16:29:08.051117 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.051083    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69"]
Jul 21 16:29:08.054000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.053904    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ps9h7"]
Jul 21 16:29:08.061637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.061517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58b59cb77b-zj22b"]
Jul 21 16:29:08.062499 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:08.062472    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6d6bd9_9abb_4693_a65f_0cc455f79821.slice/crio-5e919257bc28cdebc66d8a460e465d5375ce647dcfa69659bc18907739ddc93b WatchSource:0}: Error finding container 5e919257bc28cdebc66d8a460e465d5375ce647dcfa69659bc18907739ddc93b: Status 404 returned error can't find the container with id 5e919257bc28cdebc66d8a460e465d5375ce647dcfa69659bc18907739ddc93b
Jul 21 16:29:08.064511 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:08.064331    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca29479a_4684_44ed_ab84_e83bb8676bab.slice/crio-bb590674672f3d6fd582be86ef86a4208cf9b0e4f0e9587df8fe73049a81f371 WatchSource:0}: Error finding container bb590674672f3d6fd582be86ef86a4208cf9b0e4f0e9587df8fe73049a81f371: Status 404 returned error can't find the container with id bb590674672f3d6fd582be86ef86a4208cf9b0e4f0e9587df8fe73049a81f371
Jul 21 16:29:08.074040 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:08.073931    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819d4b8d_220e_4731_a09f_8138b4ac316c.slice/crio-0148b610eca33016e63e306bac9cf53c7529ceb69d68bec98c1540e0094addfc WatchSource:0}: Error finding container 0148b610eca33016e63e306bac9cf53c7529ceb69d68bec98c1540e0094addfc: Status 404 returned error can't find the container with id 0148b610eca33016e63e306bac9cf53c7529ceb69d68bec98c1540e0094addfc
Jul 21 16:29:08.665655 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.663487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:08.764111 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.763976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q" event={"ID":"92f64932-2fc7-4438-bc0e-6b8858c142c5","Type":"ContainerStarted","Data":"adce30d27540baefbe3461867bc9f98196df4d09c6e9a243f2dba25d821f0dcd"}
Jul 21 16:29:08.766889 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.766850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6clr" event={"ID":"81934a32-6460-4a08-b572-9b0602ebb0f4","Type":"ContainerStarted","Data":"2df2b89b73aaa8fbc6054795718ec1962b10d6ca465e315716c38994f1678dc6"}
Jul 21 16:29:08.767686 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.767607    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:08.768597 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.768547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69" event={"ID":"819d4b8d-220e-4731-a09f-8138b4ac316c","Type":"ContainerStarted","Data":"0148b610eca33016e63e306bac9cf53c7529ceb69d68bec98c1540e0094addfc"}
Jul 21 16:29:08.770347 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.770287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ps9h7" event={"ID":"ca29479a-4684-44ed-ab84-e83bb8676bab","Type":"ContainerStarted","Data":"bb590674672f3d6fd582be86ef86a4208cf9b0e4f0e9587df8fe73049a81f371"}
Jul 21 16:29:08.773097 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.773056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" event={"ID":"b059965e-ba61-4fa1-b8bb-891c9fc3a56a","Type":"ContainerStarted","Data":"abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177"}
Jul 21 16:29:08.773228 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.773105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" event={"ID":"b059965e-ba61-4fa1-b8bb-891c9fc3a56a","Type":"ContainerStarted","Data":"8a11f9c3746975f25bd48f33d2e3f80bb3631c7481dfa66780c1fc86011924dc"}
Jul 21 16:29:08.774021 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.773961    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:08.777223 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.776705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnthg" event={"ID":"00314b86-e6f3-4785-9870-ace7beeb1caa","Type":"ContainerStarted","Data":"5858126aaba29498b3115662024593d2a354e0ab21cc7d42765c134e082a3db1"}
Jul 21 16:29:08.777223 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.776760    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnthg" event={"ID":"00314b86-e6f3-4785-9870-ace7beeb1caa","Type":"ContainerStarted","Data":"4d94ac8f0fc80ba8ff55ec34e2d86ff35a454f7b1f1465ce16a40893aacf6b38"}
Jul 21 16:29:08.780451 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.780421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58b59cb77b-zj22b" event={"ID":"ff6d6bd9-9abb-4693-a65f-0cc455f79821","Type":"ContainerStarted","Data":"502ab64ef952659e25a146e56da2c6d750145970b4c651ea5be107f6af2b9611"}
Jul 21 16:29:08.780577 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.780471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58b59cb77b-zj22b" event={"ID":"ff6d6bd9-9abb-4693-a65f-0cc455f79821","Type":"ContainerStarted","Data":"5e919257bc28cdebc66d8a460e465d5375ce647dcfa69659bc18907739ddc93b"}
Jul 21 16:29:08.780577 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.780497    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:29:08.786791 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.786760    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-2zslp"
Jul 21 16:29:08.796019 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.794903    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" podStartSLOduration=69.794877449 podStartE2EDuration="1m9.794877449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:08.793404321 +0000 UTC m=+71.061396996" watchObservedRunningTime="2026-07-21 16:29:08.794877449 +0000 UTC m=+71.062870124"
Jul 21 16:29:08.827852 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.827815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:08.833695 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.833590    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wnthg" podStartSLOduration=67.103323177 podStartE2EDuration="1m10.833566798s" totalImagesPullingTime="3.730243621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:08.830590706 +0000 UTC m=+71.098583380" watchObservedRunningTime="2026-07-21 16:29:08.833566798 +0000 UTC m=+71.101559473"
Jul 21 16:29:08.950761 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:08.950645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.195647 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.195584    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58b59cb77b-zj22b" podStartSLOduration=64.19555902 podStartE2EDuration="1m4.19555902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:08.853408817 +0000 UTC m=+71.121401492" watchObservedRunningTime="2026-07-21 16:29:09.19555902 +0000 UTC m=+71.463551695"
Jul 21 16:29:09.199192 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.198202    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"]
Jul 21 16:29:09.201515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.201240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.204251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.203498    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"]
Jul 21 16:29:09.204251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.203839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.206559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.205917    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"]
Jul 21 16:29:09.206559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.206514    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.208184 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.208143    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 16:29:09.208595 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.208579    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 16:29:09.209385 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.208820    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 16:29:09.209385 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.208885    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"]
Jul 21 16:29:09.209385 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.208974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.209577 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.209518    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wd2vl\""
Jul 21 16:29:09.209631 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.209592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 16:29:09.210867 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.210844    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 16:29:09.211568 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.211544    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 16:29:09.212849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.212695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 16:29:09.213185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.213153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 16:29:09.213811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.213793    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 16:29:09.227113 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.225870    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"]
Jul 21 16:29:09.238968 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.238882    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"]
Jul 21 16:29:09.305881 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.305836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c836e2-b96d-4fa1-9277-408d4398ccdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.306079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.305916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrlcf\" (UniqueName: \"kubernetes.io/projected/c36ca219-a778-4818-8adc-de87eca47d61-kube-api-access-zrlcf\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.306079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.305956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/893518be-9788-4873-8ed3-acb3b5e404a1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7dbb8f97b-6jk24\" (UID: \"893518be-9788-4873-8ed3-acb3b5e404a1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.306079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.305988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c36ca219-a778-4818-8adc-de87eca47d61-klusterlet-config\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.306079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvn4f\" (UniqueName: \"kubernetes.io/projected/893518be-9788-4873-8ed3-acb3b5e404a1-kube-api-access-mvn4f\") pod \"managed-serviceaccount-addon-agent-7dbb8f97b-6jk24\" (UID: \"893518be-9788-4873-8ed3-acb3b5e404a1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.306079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c36ca219-a778-4818-8adc-de87eca47d61-tmp\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.306079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.306402 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklb5\" (UniqueName: \"kubernetes.io/projected/30c836e2-b96d-4fa1-9277-408d4398ccdf-kube-api-access-vklb5\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.306402 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-ca\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.306402 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-hub\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.306402 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.306199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.333406 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.333371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.342238 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.342204    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-sp8dt"]
Jul 21 16:29:09.344877 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.344849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:09.348275 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.348246    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 16:29:09.348508 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.348489    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 16:29:09.348919 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.348754    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8rxzt\""
Jul 21 16:29:09.371283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.371208    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-sp8dt"]
Jul 21 16:29:09.406666 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/893518be-9788-4873-8ed3-acb3b5e404a1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7dbb8f97b-6jk24\" (UID: \"893518be-9788-4873-8ed3-acb3b5e404a1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c36ca219-a778-4818-8adc-de87eca47d61-klusterlet-config\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn4f\" (UniqueName: \"kubernetes.io/projected/893518be-9788-4873-8ed3-acb3b5e404a1-kube-api-access-mvn4f\") pod \"managed-serviceaccount-addon-agent-7dbb8f97b-6jk24\" (UID: \"893518be-9788-4873-8ed3-acb3b5e404a1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c36ca219-a778-4818-8adc-de87eca47d61-tmp\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklb5\" (UniqueName: \"kubernetes.io/projected/30c836e2-b96d-4fa1-9277-408d4398ccdf-kube-api-access-vklb5\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-ca\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.406858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-hub\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.409179 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.409179 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.406939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c836e2-b96d-4fa1-9277-408d4398ccdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.409179 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.407015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrlcf\" (UniqueName: \"kubernetes.io/projected/c36ca219-a778-4818-8adc-de87eca47d61-kube-api-access-zrlcf\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.409179 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.408809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c36ca219-a778-4818-8adc-de87eca47d61-tmp\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.409996 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.409907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c836e2-b96d-4fa1-9277-408d4398ccdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.417526 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.417424    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.418251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.418128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.418386 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.418343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-hub\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.419581 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.419108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30c836e2-b96d-4fa1-9277-408d4398ccdf-ca\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.421935 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.421903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvn4f\" (UniqueName: \"kubernetes.io/projected/893518be-9788-4873-8ed3-acb3b5e404a1-kube-api-access-mvn4f\") pod \"managed-serviceaccount-addon-agent-7dbb8f97b-6jk24\" (UID: \"893518be-9788-4873-8ed3-acb3b5e404a1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.426949 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.426675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/893518be-9788-4873-8ed3-acb3b5e404a1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7dbb8f97b-6jk24\" (UID: \"893518be-9788-4873-8ed3-acb3b5e404a1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.426949 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.426675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklb5\" (UniqueName: \"kubernetes.io/projected/30c836e2-b96d-4fa1-9277-408d4398ccdf-kube-api-access-vklb5\") pod \"cluster-proxy-proxy-agent-58d9d4f746-5pdtn\" (UID: \"30c836e2-b96d-4fa1-9277-408d4398ccdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.429958 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.429926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c36ca219-a778-4818-8adc-de87eca47d61-klusterlet-config\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.438049 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.437979    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.444344 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.444311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrlcf\" (UniqueName: \"kubernetes.io/projected/c36ca219-a778-4818-8adc-de87eca47d61-kube-api-access-zrlcf\") pod \"klusterlet-addon-workmgr-6655655bdf-tnbjn\" (UID: \"c36ca219-a778-4818-8adc-de87eca47d61\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.508529 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.508362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwjz\" (UniqueName: \"kubernetes.io/projected/bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6-kube-api-access-fpwjz\") pod \"downloads-5bc67dcd46-sp8dt\" (UID: \"bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6\") " pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:09.534589 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.534554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.552021 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.551714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"
Jul 21 16:29:09.565012 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.564692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:09.575086 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.574800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"
Jul 21 16:29:09.609962 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.609651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwjz\" (UniqueName: \"kubernetes.io/projected/bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6-kube-api-access-fpwjz\") pod \"downloads-5bc67dcd46-sp8dt\" (UID: \"bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6\") " pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:09.636838 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.636778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwjz\" (UniqueName: \"kubernetes.io/projected/bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6-kube-api-access-fpwjz\") pod \"downloads-5bc67dcd46-sp8dt\" (UID: \"bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6\") " pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:09.637588 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.637323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.670998 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.670935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:09.735127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.735074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:09.749735 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.748934    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:09.752426 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.752393    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:09.789530 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.788769    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:09.789530 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.788888    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58b59cb77b-zj22b"
Jul 21 16:29:09.800052 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:09.799892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:10.119449 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:10.119317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:10.177475 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:10.177445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:10.828467 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:10.828382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:10.887416 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:10.887367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:11.009595 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:11.009559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:11.159223 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:11.159079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:11.259198 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:11.259145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:14.331584 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:14.331550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24"]
Jul 21 16:29:14.457865 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:14.457638    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"]
Jul 21 16:29:15.081580 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.081544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:15.181140 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.181100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:15.247468 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:15.246347    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36ca219_a778_4818_8adc_de87eca47d61.slice/crio-13c39d79cae78aabd00e998316e7c86d657aeb3827c430083f1e128988271d7d WatchSource:0}: Error finding container 13c39d79cae78aabd00e998316e7c86d657aeb3827c430083f1e128988271d7d: Status 404 returned error can't find the container with id 13c39d79cae78aabd00e998316e7c86d657aeb3827c430083f1e128988271d7d
Jul 21 16:29:15.247468 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:15.247450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893518be_9788_4873_8ed3_acb3b5e404a1.slice/crio-4c36726913b7d30b04fbe1fff6095a24c31f91ef3d66fbfdbdb12c59e0ba244e WatchSource:0}: Error finding container 4c36726913b7d30b04fbe1fff6095a24c31f91ef3d66fbfdbdb12c59e0ba244e: Status 404 returned error can't find the container with id 4c36726913b7d30b04fbe1fff6095a24c31f91ef3d66fbfdbdb12c59e0ba244e
Jul 21 16:29:15.397695 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.397506    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn"]
Jul 21 16:29:15.412684 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.412658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-sp8dt"]
Jul 21 16:29:15.449274 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:15.449242    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30c836e2_b96d_4fa1_9277_408d4398ccdf.slice/crio-2ea251e5989c6b7facc697e18fa04d64ef6c0a0f96095224f4b3985d78418a7d WatchSource:0}: Error finding container 2ea251e5989c6b7facc697e18fa04d64ef6c0a0f96095224f4b3985d78418a7d: Status 404 returned error can't find the container with id 2ea251e5989c6b7facc697e18fa04d64ef6c0a0f96095224f4b3985d78418a7d
Jul 21 16:29:15.450387 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:15.450358    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb711dc_4ac5_4907_ac2c_3d4fb174dfb6.slice/crio-822e008b8e5cd376813ce67579dfadc5f8de1451f89cbe4ee88ee3628ac780bf WatchSource:0}: Error finding container 822e008b8e5cd376813ce67579dfadc5f8de1451f89cbe4ee88ee3628ac780bf: Status 404 returned error can't find the container with id 822e008b8e5cd376813ce67579dfadc5f8de1451f89cbe4ee88ee3628ac780bf
Jul 21 16:29:15.815127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.815085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24" event={"ID":"893518be-9788-4873-8ed3-acb3b5e404a1","Type":"ContainerStarted","Data":"4c36726913b7d30b04fbe1fff6095a24c31f91ef3d66fbfdbdb12c59e0ba244e"}
Jul 21 16:29:15.824153 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.824115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:15.824817 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.824685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vdds" event={"ID":"52c5b102-a3da-43a7-867e-d143f298e61b","Type":"ContainerStarted","Data":"c412969866676b8a6cb1b7d57b22ac664d7afac274368747fd898ad15eeff070"}
Jul 21 16:29:15.827457 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.827396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn" event={"ID":"c36ca219-a778-4818-8adc-de87eca47d61","Type":"ContainerStarted","Data":"13c39d79cae78aabd00e998316e7c86d657aeb3827c430083f1e128988271d7d"}
Jul 21 16:29:15.829701 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.829669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn" event={"ID":"30c836e2-b96d-4fa1-9277-408d4398ccdf","Type":"ContainerStarted","Data":"2ea251e5989c6b7facc697e18fa04d64ef6c0a0f96095224f4b3985d78418a7d"}
Jul 21 16:29:15.833143 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.833118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q" event={"ID":"92f64932-2fc7-4438-bc0e-6b8858c142c5","Type":"ContainerStarted","Data":"7784b653cfe7b620001255740cde1be2858af5cd6e4cc257296833a330bf1380"}
Jul 21 16:29:15.834877 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.834849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69" event={"ID":"819d4b8d-220e-4731-a09f-8138b4ac316c","Type":"ContainerStarted","Data":"93c844b846ecb4bc1d56e47688c7593a9c77d7d814810a17e76a933d7e1e07a7"}
Jul 21 16:29:15.837380 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.837317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ps9h7" event={"ID":"ca29479a-4684-44ed-ab84-e83bb8676bab","Type":"ContainerStarted","Data":"dc169a8f9f61f3af797a37bc67e1818fecc35112d3ae68e7e2d2d5c1dadf2961"}
Jul 21 16:29:15.838849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.838816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-sp8dt" event={"ID":"bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6","Type":"ContainerStarted","Data":"822e008b8e5cd376813ce67579dfadc5f8de1451f89cbe4ee88ee3628ac780bf"}
Jul 21 16:29:15.856063 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.855988    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5vdds" podStartSLOduration=69.122047533 podStartE2EDuration="1m17.855949169s" totalImagesPullingTime="8.733901636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:15.854246598 +0000 UTC m=+78.122239272" watchObservedRunningTime="2026-07-21 16:29:15.855949169 +0000 UTC m=+78.123941843"
Jul 21 16:29:15.871417 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.871358    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-vqn6q" podStartSLOduration=39.614976618 podStartE2EDuration="45.871336521s" totalImagesPullingTime="6.256359903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:15.869483695 +0000 UTC m=+78.137476370" watchObservedRunningTime="2026-07-21 16:29:15.871336521 +0000 UTC m=+78.139329196"
Jul 21 16:29:15.885368 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.885307    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v8q69" podStartSLOduration=64.652501191 podStartE2EDuration="1m10.885280479s" totalImagesPullingTime="6.232779288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:15.884963459 +0000 UTC m=+78.152956135" watchObservedRunningTime="2026-07-21 16:29:15.885280479 +0000 UTC m=+78.153273149"
Jul 21 16:29:15.923767 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:15.923738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.008398 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.008361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.082372 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.082287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.480445 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.480329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:16.848244 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.847985    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6clr" event={"ID":"81934a32-6460-4a08-b572-9b0602ebb0f4","Type":"ContainerStarted","Data":"36db198f9d77a074743f6342b4789da41697017301b9b791689f6c71f78be843"}
Jul 21 16:29:16.859518 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.858587    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ps9h7" event={"ID":"ca29479a-4684-44ed-ab84-e83bb8676bab","Type":"ContainerStarted","Data":"057cb436c65d14c809edfe3b2e722f849bf7acbb5fd2dc613fcdda6427c2653c"}
Jul 21 16:29:16.859518 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.859453    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:29:16.878386 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:16.877286    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ps9h7" podStartSLOduration=35.699138929 podStartE2EDuration="42.877264225s" totalImagesPullingTime="7.178125296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:16.875513221 +0000 UTC m=+79.143505895" watchObservedRunningTime="2026-07-21 16:29:16.877264225 +0000 UTC m=+79.145256902"
Jul 21 16:29:21.475380 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:21.474867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:21.575574 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:21.575486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:22.104261 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:22.104229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:22.162652 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:22.162614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:22.565325 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:22.565241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:22.762417 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:22.762335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:22.817977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:22.817872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.045358 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.045322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.110843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.110752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.223475 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.223434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.766661 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.766619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.867156 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.867057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.910775 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.910189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6clr" event={"ID":"81934a32-6460-4a08-b572-9b0602ebb0f4","Type":"ContainerStarted","Data":"6f9d1457b5e4b7c7c1998d15a2622875a9ea8a75f84489c1d0236cb57ced0f3c"}
Jul 21 16:29:25.912136 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.912105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24" event={"ID":"893518be-9788-4873-8ed3-acb3b5e404a1","Type":"ContainerStarted","Data":"1bedae35d2fa893e869dcb21b644b336657415a19ddb3c841384b61e0536a9c1"}
Jul 21 16:29:25.914494 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.914466    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn" event={"ID":"c36ca219-a778-4818-8adc-de87eca47d61","Type":"ContainerStarted","Data":"073eea5d78be11ea615a405336d8a927d598f86ec537ef55adfcc8ff8867c4a8"}
Jul 21 16:29:25.914623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.914585    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:25.918965 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.918633    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn"
Jul 21 16:29:25.919843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.919816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn" event={"ID":"30c836e2-b96d-4fa1-9277-408d4398ccdf","Type":"ContainerStarted","Data":"44659f3699d9e12fdedafb4e653bd80cac6940c338074c8d574c7b24fb2de136"}
Jul 21 16:29:25.919934 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.919857    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn" event={"ID":"30c836e2-b96d-4fa1-9277-408d4398ccdf","Type":"ContainerStarted","Data":"b15a5dc6ccfe91ad70f99f6b50cf134213c5aa1452fecdd310c4f732bc818978"}
Jul 21 16:29:25.919934 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.919876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn" event={"ID":"30c836e2-b96d-4fa1-9277-408d4398ccdf","Type":"ContainerStarted","Data":"dbb7ebb76bbae80d927fcad6ff1c9979594848d69ef3c1ce28cbf44626fcb2e0"}
Jul 21 16:29:25.927682 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.927639    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p6clr" podStartSLOduration=17.059061566 podStartE2EDuration="39.927621073s" totalImagesPullingTime="22.868559507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:25.926837737 +0000 UTC m=+88.194830412" watchObservedRunningTime="2026-07-21 16:29:25.927621073 +0000 UTC m=+88.195613748"
Jul 21 16:29:25.943843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.943782    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58d9d4f746-5pdtn" podStartSLOduration=7.18006767 podStartE2EDuration="16.943759017s" totalImagesPullingTime="9.763691347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:25.942619943 +0000 UTC m=+88.210612610" watchObservedRunningTime="2026-07-21 16:29:25.943759017 +0000 UTC m=+88.211751691"
Jul 21 16:29:25.957883 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.957833    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7dbb8f97b-6jk24" podStartSLOduration=7.044360706 podStartE2EDuration="16.957813764s" totalImagesPullingTime="9.913453058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:25.95707578 +0000 UTC m=+88.225068455" watchObservedRunningTime="2026-07-21 16:29:25.957813764 +0000 UTC m=+88.225806440"
Jul 21 16:29:25.971681 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:25.971623    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6655655bdf-tnbjn" podStartSLOduration=7.037194716 podStartE2EDuration="16.971604637s" totalImagesPullingTime="9.934409921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:25.971256681 +0000 UTC m=+88.239249401" watchObservedRunningTime="2026-07-21 16:29:25.971604637 +0000 UTC m=+88.239597317"
Jul 21 16:29:26.329405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:26.329324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:26.429076 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:26.429041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:26.782470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:26.782429    2575 patch_prober.go:28] interesting pod/image-registry-775f4d885b-qwn7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 16:29:26.782733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:26.782494    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" podUID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:29:27.872880 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:27.872839    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ps9h7"
Jul 21 16:29:28.551906 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:28.551806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:28.607779 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:28.607734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:28.660560 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:28.660523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:29.005891 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:29.005859    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:30.796080 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:30.796046    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:31.056010 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.055936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.168801 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.168753    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.261092 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.261043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.378647 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.378534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.471015 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.470060    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9vqmf"]
Jul 21 16:29:31.471015 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.470874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.578474 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.578436    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.581045 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.581006    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 16:29:31.581045 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.581007    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 16:29:31.581411 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.581387    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-77mcm\""
Jul 21 16:29:31.581506 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.581488    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 16:29:31.581752 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.581731    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 16:29:31.612321 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.612260    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.621272 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-sys\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-tls\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-textfile\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r84g4\" (UniqueName: \"kubernetes.io/projected/bb57f28a-0861-4e86-9338-625de1fa821f-kube-api-access-r84g4\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-wtmp\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb57f28a-0861-4e86-9338-625de1fa821f-metrics-client-ca\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621777 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.621777 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.621528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-root\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.710011 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.709855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.722847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.722789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-sys\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.722872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.722903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-tls\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.722931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-textfile\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.722954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r84g4\" (UniqueName: \"kubernetes.io/projected/bb57f28a-0861-4e86-9338-625de1fa821f-kube-api-access-r84g4\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.722984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-wtmp\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.723015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb57f28a-0861-4e86-9338-625de1fa821f-metrics-client-ca\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723047 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.723043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723419 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.723074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-root\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723419 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.723224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-root\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.723419 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.723280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-sys\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.724829 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:29:31.723771    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 16:29:31.724829 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:29:31.723834    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-tls podName:bb57f28a-0861-4e86-9338-625de1fa821f nodeName:}" failed. No retries permitted until 2026-07-21 16:29:32.223814679 +0000 UTC m=+94.491807331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-tls") pod "node-exporter-9vqmf" (UID: "bb57f28a-0861-4e86-9338-625de1fa821f") : secret "node-exporter-tls" not found
Jul 21 16:29:31.724829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.724246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-textfile\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.724829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.724299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-wtmp\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.724829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.724577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb57f28a-0861-4e86-9338-625de1fa821f-metrics-client-ca\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.724829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.724755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.735338 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.735306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r84g4\" (UniqueName: \"kubernetes.io/projected/bb57f28a-0861-4e86-9338-625de1fa821f-kube-api-access-r84g4\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.736852 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.736795    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:31.810366 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.810276    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:31.914288 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:31.914203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.016275 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.016242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.115215 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.115154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.229974 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.229935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-tls\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:32.232794 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.232767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb57f28a-0861-4e86-9338-625de1fa821f-node-exporter-tls\") pod \"node-exporter-9vqmf\" (UID: \"bb57f28a-0861-4e86-9338-625de1fa821f\") " pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:32.235678 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.235648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.436142 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.436057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.492943 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.492902    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vqmf"
Jul 21 16:29:32.536187 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.536117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.744813 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:32.744762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:33.443057 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:33.443022    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775f4d885b-qwn7m"]
Jul 21 16:29:33.477023 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:33.476989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:33.578453 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:33.578417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:33.647981 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:33.647930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:33.840446 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:33.840411    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:33.949746 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:33.949705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:34.482467 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:34.482434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:34.583637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:34.583593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:34.713979 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:34.713926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:34.814561 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:34.814507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:35.560353 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:35.560303    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:35.644051 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:29:35.644011    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb57f28a_0861_4e86_9338_625de1fa821f.slice/crio-ee37518a7e5d9449d0cfdf8e5be5fb43de8211074043bace3ab60d4cb5467c63 WatchSource:0}: Error finding container ee37518a7e5d9449d0cfdf8e5be5fb43de8211074043bace3ab60d4cb5467c63: Status 404 returned error can't find the container with id ee37518a7e5d9449d0cfdf8e5be5fb43de8211074043bace3ab60d4cb5467c63
Jul 21 16:29:35.659841 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:35.659811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:35.695879 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:35.695851    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfhlt"
Jul 21 16:29:35.866350 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:35.866271    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:35.965740 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:35.965707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqmf" event={"ID":"bb57f28a-0861-4e86-9338-625de1fa821f","Type":"ContainerStarted","Data":"ee37518a7e5d9449d0cfdf8e5be5fb43de8211074043bace3ab60d4cb5467c63"}
Jul 21 16:29:36.242176 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.242139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:36.333842 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.333801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:36.498199 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.498148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:36.794798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.794709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:36.895315 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.895282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:36.959598 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.959499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:36.973111 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.973076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-sp8dt" event={"ID":"bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6","Type":"ContainerStarted","Data":"aa848377bcc906212edb12d2e3a31a3b324bbd4f5ed9ecd9dec8c7f3101a9b3e"}
Jul 21 16:29:36.974254 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.974190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:36.992055 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.992024    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-sp8dt"
Jul 21 16:29:36.994813 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:36.994674    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-sp8dt" podStartSLOduration=7.401808221 podStartE2EDuration="27.994652617s" totalImagesPullingTime="20.592844396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:36.993971754 +0000 UTC m=+99.261964430" watchObservedRunningTime="2026-07-21 16:29:36.994652617 +0000 UTC m=+99.262645292"
Jul 21 16:29:37.768892 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:37.768794    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:37.928558 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:37.928524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:37.980667 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:37.980598    2575 generic.go:356] "Generic (PLEG): container finished" podID="bb57f28a-0861-4e86-9338-625de1fa821f" containerID="250280cbfb05fa27e40e35cd8f1a14d45f50d4c6e48844c5fb1300f7c3dc43f1" exitCode=0
Jul 21 16:29:37.980873 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:37.980705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqmf" event={"ID":"bb57f28a-0861-4e86-9338-625de1fa821f","Type":"ContainerDied","Data":"250280cbfb05fa27e40e35cd8f1a14d45f50d4c6e48844c5fb1300f7c3dc43f1"}
Jul 21 16:29:38.929761 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:38.929726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:38.988821 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:38.988774    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqmf" event={"ID":"bb57f28a-0861-4e86-9338-625de1fa821f","Type":"ContainerStarted","Data":"57bf279f5c00ed3c4f1b312edfbce821ff03a598f5903dbdd9703d188d36d2a0"}
Jul 21 16:29:38.989016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:38.988854    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vqmf" event={"ID":"bb57f28a-0861-4e86-9338-625de1fa821f","Type":"ContainerStarted","Data":"8d74817b45820efdadfd98b512967f61fd5d0523ca8b3b03077cfe0a4414bb14"}
Jul 21 16:29:39.013531 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:39.013454    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9vqmf" podStartSLOduration=6.065690478 podStartE2EDuration="8.013435344s" totalImagesPullingTime="1.869276118s" totalInitContainerRuntime="78.468748ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:39.012972319 +0000 UTC m=+101.280964995" watchObservedRunningTime="2026-07-21 16:29:39.013435344 +0000 UTC m=+101.281428021"
Jul 21 16:29:39.027977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:39.027939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:39.183015 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:39.182926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:39.279499 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:39.279462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:41.865185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:41.865137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:41.969371 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:41.969338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:42.845310 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:42.845270    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:42.942919 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:42.942883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:45.970660 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:45.970623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:46.066290 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:46.066257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:47.262436 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:47.262403    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:47.337834 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:47.337798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:51.040270 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:51.040234    2575 generic.go:356] "Generic (PLEG): container finished" podID="af52519d-6ccf-4525-b833-feabf84c514c" containerID="d24a416e6fa6aef0b63cc72abe81bc0e1d03efe5757277f2025ef8959e9f5d63" exitCode=0
Jul 21 16:29:51.040743 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:51.040306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7" event={"ID":"af52519d-6ccf-4525-b833-feabf84c514c","Type":"ContainerDied","Data":"d24a416e6fa6aef0b63cc72abe81bc0e1d03efe5757277f2025ef8959e9f5d63"}
Jul 21 16:29:51.040743 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:51.040624    2575 scope.go:117] "RemoveContainer" containerID="d24a416e6fa6aef0b63cc72abe81bc0e1d03efe5757277f2025ef8959e9f5d63"
Jul 21 16:29:51.539962 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:51.539911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:51.600550 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:51.600514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:52.046259 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:52.046219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g4sm7" event={"ID":"af52519d-6ccf-4525-b833-feabf84c514c","Type":"ContainerStarted","Data":"766f6764c0de42117f837208b262916af601ea2b27214230ea322117cc808ffe"}
Jul 21 16:29:52.623796 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:52.623751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:52.725094 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:52.725057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:52.825813 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:52.825754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:58.468379 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.468322    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" podUID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" containerName="registry" containerID="cri-o://abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177" gracePeriod=30
Jul 21 16:29:58.753869 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.753825    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:58.876137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876095    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-installation-pull-secrets\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876156    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-trusted-ca\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876217    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-ca-trust-extracted\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876234    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-bound-sa-token\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876284    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqkwh\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-kube-api-access-gqkwh\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876332 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876322    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-image-registry-private-configuration\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-certificates\") pod \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\" (UID: \"b059965e-ba61-4fa1-b8bb-891c9fc3a56a\") "
Jul 21 16:29:58.876862 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876718    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:58.877150 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.876922    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:29:58.879279 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.879219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:58.879279 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.879229    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:58.879421 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.879331    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:58.879535 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.879507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:29:58.879646 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.879622    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-kube-api-access-gqkwh" (OuterVolumeSpecName: "kube-api-access-gqkwh") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "kube-api-access-gqkwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:58.884932 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.884906    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b059965e-ba61-4fa1-b8bb-891c9fc3a56a" (UID: "b059965e-ba61-4fa1-b8bb-891c9fc3a56a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977583    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-installation-pull-secrets\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977612    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-trusted-ca\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977623    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-tls\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977630    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-ca-trust-extracted\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977638    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-bound-sa-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977646    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqkwh\" (UniqueName: \"kubernetes.io/projected/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-kube-api-access-gqkwh\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977655    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-image-registry-private-configuration\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:58.977662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:58.977665    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b059965e-ba61-4fa1-b8bb-891c9fc3a56a-registry-certificates\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:29:59.072619 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.072582    2575 generic.go:356] "Generic (PLEG): container finished" podID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" containerID="abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177" exitCode=0
Jul 21 16:29:59.072765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.072632    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m"
Jul 21 16:29:59.072765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.072669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" event={"ID":"b059965e-ba61-4fa1-b8bb-891c9fc3a56a","Type":"ContainerDied","Data":"abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177"}
Jul 21 16:29:59.072765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.072729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f4d885b-qwn7m" event={"ID":"b059965e-ba61-4fa1-b8bb-891c9fc3a56a","Type":"ContainerDied","Data":"8a11f9c3746975f25bd48f33d2e3f80bb3631c7481dfa66780c1fc86011924dc"}
Jul 21 16:29:59.072765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.072751    2575 scope.go:117] "RemoveContainer" containerID="abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177"
Jul 21 16:29:59.082037 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.082019    2575 scope.go:117] "RemoveContainer" containerID="abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177"
Jul 21 16:29:59.082397 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:29:59.082375    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177\": container with ID starting with abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177 not found: ID does not exist" containerID="abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177"
Jul 21 16:29:59.082458 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.082406    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177"} err="failed to get container status \"abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177\": rpc error: code = NotFound desc = could not find container \"abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177\": container with ID starting with abf2df94c0d72a225204ba6636797eae3b0aca5ff2eb1ece43d85f6cd5b38177 not found: ID does not exist"
Jul 21 16:29:59.094038 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.094008    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775f4d885b-qwn7m"]
Jul 21 16:29:59.101102 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:29:59.101073    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-775f4d885b-qwn7m"]
Jul 21 16:30:00.244404 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:00.244369    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" path="/var/lib/kubelet/pods/b059965e-ba61-4fa1-b8bb-891c9fc3a56a/volumes"
Jul 21 16:30:01.501338 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:01.501297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:01.572683 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:01.572644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:06.102143 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:06.102107    2575 generic.go:356] "Generic (PLEG): container finished" podID="01e09e9b-370f-4ad3-8865-745845519116" containerID="85e131bfac6ff505b03dffbb9a7ea2fa6f59417e663858a36b8a33460976c97c" exitCode=0
Jul 21 16:30:06.102594 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:06.102197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-n7j2x" event={"ID":"01e09e9b-370f-4ad3-8865-745845519116","Type":"ContainerDied","Data":"85e131bfac6ff505b03dffbb9a7ea2fa6f59417e663858a36b8a33460976c97c"}
Jul 21 16:30:06.102594 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:06.102528    2575 scope.go:117] "RemoveContainer" containerID="85e131bfac6ff505b03dffbb9a7ea2fa6f59417e663858a36b8a33460976c97c"
Jul 21 16:30:06.758184 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:06.758144    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58b59cb77b-zj22b_ff6d6bd9-9abb-4693-a65f-0cc455f79821/router/0.log"
Jul 21 16:30:06.764492 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:06.764456    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4kgw6_4aab204f-103a-4267-94af-f175c1cbc0df/serve-healthcheck-canary/0.log"
Jul 21 16:30:07.107948 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:07.107855    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-n7j2x" event={"ID":"01e09e9b-370f-4ad3-8865-745845519116","Type":"ContainerStarted","Data":"7d3b226f2b2de0d10627391196e0975dcf644d319ea13f8f4cda58e0d085db85"}
Jul 21 16:30:07.937389 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:07.937341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:07.998701 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:07.998669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:14.788947 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:14.788909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:14.889045 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:14.889008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:14.956527 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:14.956488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:16.144420 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:16.144369    2575 generic.go:356] "Generic (PLEG): container finished" podID="708be621-6f4a-4a77-89b2-95fb2b98a435" containerID="c2d647ee6f3198c218a0949c295c356343969b9ce6e0656acf80127692efe5e4" exitCode=0
Jul 21 16:30:16.144836 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:16.144448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft" event={"ID":"708be621-6f4a-4a77-89b2-95fb2b98a435","Type":"ContainerDied","Data":"c2d647ee6f3198c218a0949c295c356343969b9ce6e0656acf80127692efe5e4"}
Jul 21 16:30:16.144836 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:16.144810    2575 scope.go:117] "RemoveContainer" containerID="c2d647ee6f3198c218a0949c295c356343969b9ce6e0656acf80127692efe5e4"
Jul 21 16:30:17.150863 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:17.150830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gmjft" event={"ID":"708be621-6f4a-4a77-89b2-95fb2b98a435","Type":"ContainerStarted","Data":"9ef6b15872aeb505b235acdba8c58b4c213b5164d0bc6a451581d6d01712f159"}
Jul 21 16:30:26.570311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:26.570272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:47.641036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:47.640984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:47.742001 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:47.741968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:53.087253 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:53.087149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:53.161160 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:53.161117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:53.290036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:53.290002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:53.344032 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:53.343939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:53.824602 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:53.824559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:53.903222 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:53.903184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:59.617952 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:59.617912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:59.673641 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:30:59.673602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:03.910603 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:03.910563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:04.680259 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:04.680219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:04.781411 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:04.781381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:07.770586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:07.770548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:07.872303 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:07.872260    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:07.971422 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:07.971388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.952565 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:36.952524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:37.031004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:37.030963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:38.047518 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:38.047483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:43.858856 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:43.858815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:43.971662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:43.971620    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:46.669552 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:46.669520    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:50.201373 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:50.201331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:50.290841 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:31:50.290809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:07.336499 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:07.336458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:11.575972 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:11.575934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:11.685131 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:11.685077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:13.344122 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:13.344083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:14.022623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:14.022594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:14.149790 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:14.149733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:14.731649 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:14.731612    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:14.917692 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:14.917658    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:16.401014 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:16.400969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:16.621094 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:16.621064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:23.679654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:23.679567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:25.538320 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:25.538289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:25.681453 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:25.681421    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:32.245287 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:32.245252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:32.380534 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:32.380493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:33.995720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:33.995673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:41.337189 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:41.337117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:41.582825 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:41.582792    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:46.659852 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:46.659815    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:46.880264 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:46.880224    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:47.296393 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:47.296359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.175558 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.175530    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.273216 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.273156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.421061 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.421020    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"]
Jul 21 16:32:48.421369 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.421350    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" containerName="registry"
Jul 21 16:32:48.421369 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.421372    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" containerName="registry"
Jul 21 16:32:48.421514 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.421471    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b059965e-ba61-4fa1-b8bb-891c9fc3a56a" containerName="registry"
Jul 21 16:32:48.423449 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.423430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.433396 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.433371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 16:32:48.433490 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.433441    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 16:32:48.433694 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.433680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 16:32:48.433773 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.433758    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2bwxz\""
Jul 21 16:32:48.435543 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.435531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 16:32:48.458540 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.458497    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"]
Jul 21 16:32:48.561539 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.561507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/84d05eaf-8f43-4b3a-965f-f86c49a2664e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.561717 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.561547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/84d05eaf-8f43-4b3a-965f-f86c49a2664e-manifests\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.561717 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.561584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84d05eaf-8f43-4b3a-965f-f86c49a2664e-webhook-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.561717 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.561636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vx2x\" (UniqueName: \"kubernetes.io/projected/84d05eaf-8f43-4b3a-965f-f86c49a2664e-kube-api-access-4vx2x\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.561717 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.561697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84d05eaf-8f43-4b3a-965f-f86c49a2664e-tmp\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.662324 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.662286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84d05eaf-8f43-4b3a-965f-f86c49a2664e-tmp\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.662504 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.662333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/84d05eaf-8f43-4b3a-965f-f86c49a2664e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.662504 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.662369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/84d05eaf-8f43-4b3a-965f-f86c49a2664e-manifests\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.662504 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.662413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84d05eaf-8f43-4b3a-965f-f86c49a2664e-webhook-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.662504 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.662469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vx2x\" (UniqueName: \"kubernetes.io/projected/84d05eaf-8f43-4b3a-965f-f86c49a2664e-kube-api-access-4vx2x\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.662864 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.662840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/84d05eaf-8f43-4b3a-965f-f86c49a2664e-manifests\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.664895 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.664864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84d05eaf-8f43-4b3a-965f-f86c49a2664e-tmp\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.665004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.664935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84d05eaf-8f43-4b3a-965f-f86c49a2664e-webhook-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.665004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.664971    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/84d05eaf-8f43-4b3a-965f-f86c49a2664e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.679027 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.678994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vx2x\" (UniqueName: \"kubernetes.io/projected/84d05eaf-8f43-4b3a-965f-f86c49a2664e-kube-api-access-4vx2x\") pod \"opendatahub-operator-controller-manager-87c9445c4-hvm4c\" (UID: \"84d05eaf-8f43-4b3a-965f-f86c49a2664e\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.733226 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.733101    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:48.742711 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.742666    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.882906 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.882867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.892927 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.892887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"]
Jul 21 16:32:48.897500 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:32:48.897463    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d05eaf_8f43_4b3a_965f_f86c49a2664e.slice/crio-89fe61b68c86cee221160d2dee16ad27a4bd2b28ede18fb29fa2314686331207 WatchSource:0}: Error finding container 89fe61b68c86cee221160d2dee16ad27a4bd2b28ede18fb29fa2314686331207: Status 404 returned error can't find the container with id 89fe61b68c86cee221160d2dee16ad27a4bd2b28ede18fb29fa2314686331207
Jul 21 16:32:48.992693 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:48.992613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:49.156845 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:49.156811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:49.266881 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:49.266844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:49.752736 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:49.752700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c" event={"ID":"84d05eaf-8f43-4b3a-965f-f86c49a2664e","Type":"ContainerStarted","Data":"89fe61b68c86cee221160d2dee16ad27a4bd2b28ede18fb29fa2314686331207"}
Jul 21 16:32:51.763291 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:51.763258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c" event={"ID":"84d05eaf-8f43-4b3a-965f-f86c49a2664e","Type":"ContainerStarted","Data":"c3e6536c8a232a179f9c5e7404c48777318759168bfe9c2a0004310f388faec4"}
Jul 21 16:32:53.773910 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:53.773870    2575 generic.go:356] "Generic (PLEG): container finished" podID="84d05eaf-8f43-4b3a-965f-f86c49a2664e" containerID="c3e6536c8a232a179f9c5e7404c48777318759168bfe9c2a0004310f388faec4" exitCode=0
Jul 21 16:32:53.774430 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:53.773950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c" event={"ID":"84d05eaf-8f43-4b3a-965f-f86c49a2664e","Type":"ContainerDied","Data":"c3e6536c8a232a179f9c5e7404c48777318759168bfe9c2a0004310f388faec4"}
Jul 21 16:32:54.780383 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:54.780351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c" event={"ID":"84d05eaf-8f43-4b3a-965f-f86c49a2664e","Type":"ContainerStarted","Data":"03c63a00acd7d4494a67b880f73a6e94d09f5eaf720068e1f20582a57adb21ee"}
Jul 21 16:32:54.780807 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:54.780571    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:32:54.823359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:54.823305    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c" podStartSLOduration=2.636272336 podStartE2EDuration="6.823288572s" totalImagesPullingTime="3.111302793s" totalInitContainerRuntime="1.075713443s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:54.822459959 +0000 UTC m=+297.090452635" watchObservedRunningTime="2026-07-21 16:32:54.823288572 +0000 UTC m=+297.091281324"
Jul 21 16:32:58.151522 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:58.151480    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:32:58.151963 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:58.151598    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:32:58.166545 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:58.166518    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 16:32:58.804850 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:58.804813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:58.887927 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:32:58.887895    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:00.387121 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:00.387086    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:03.603707 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:03.603670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:05.787336 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:05.787304    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-hvm4c"
Jul 21 16:33:11.018356 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:11.018314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:11.139858 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:11.139821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:11.497725 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:11.497692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:11.842050 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:11.841919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:12.052679 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:12.052646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:12.163206 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:12.163074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:12.266368 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:12.266334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:12.403494 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:12.403455    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:12.542250 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:12.542204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:13.554317 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:13.554284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:13.720266 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:13.720222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:14.226834 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:14.226800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:14.467988 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:14.467952    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:16.654274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:16.654242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:19.827436 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.827398    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"]
Jul 21 16:33:19.830576 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.830556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.834053 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.834031    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 16:33:19.834053 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.834044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 16:33:19.834270 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.834036    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:33:19.834270 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.834065    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5bd79\""
Jul 21 16:33:19.834270 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.834054    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 16:33:19.834270 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.834036    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 16:33:19.839098 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.839072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ff63e47-bb00-43eb-98f8-70863329b5e6-cert\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.839232 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.839158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ff63e47-bb00-43eb-98f8-70863329b5e6-metrics-cert\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.839314 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.839239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vzgj\" (UniqueName: \"kubernetes.io/projected/3ff63e47-bb00-43eb-98f8-70863329b5e6-kube-api-access-7vzgj\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.839374 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.839310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ff63e47-bb00-43eb-98f8-70863329b5e6-manager-config\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.840924 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.840905    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"]
Jul 21 16:33:19.940452 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.940407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ff63e47-bb00-43eb-98f8-70863329b5e6-cert\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.940653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.940478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ff63e47-bb00-43eb-98f8-70863329b5e6-metrics-cert\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.940653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.940516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vzgj\" (UniqueName: \"kubernetes.io/projected/3ff63e47-bb00-43eb-98f8-70863329b5e6-kube-api-access-7vzgj\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.940653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.940546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ff63e47-bb00-43eb-98f8-70863329b5e6-manager-config\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.941141 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.941118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ff63e47-bb00-43eb-98f8-70863329b5e6-manager-config\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.943080 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.943046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ff63e47-bb00-43eb-98f8-70863329b5e6-metrics-cert\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.943178 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.943099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ff63e47-bb00-43eb-98f8-70863329b5e6-cert\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:19.950778 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:19.950752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vzgj\" (UniqueName: \"kubernetes.io/projected/3ff63e47-bb00-43eb-98f8-70863329b5e6-kube-api-access-7vzgj\") pod \"lws-controller-manager-54b99c46f6-n6xtm\" (UID: \"3ff63e47-bb00-43eb-98f8-70863329b5e6\") " pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:20.140462 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:20.140365    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:20.164515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:20.164482    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:20.326566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:20.326524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:20.328447 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:20.328420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"]
Jul 21 16:33:20.333394 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:33:20.333365    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff63e47_bb00_43eb_98f8_70863329b5e6.slice/crio-d67577561105d97c581d606dbfe65d7785adc00a0adaa2833aa5a61ad4545879 WatchSource:0}: Error finding container d67577561105d97c581d606dbfe65d7785adc00a0adaa2833aa5a61ad4545879: Status 404 returned error can't find the container with id d67577561105d97c581d606dbfe65d7785adc00a0adaa2833aa5a61ad4545879
Jul 21 16:33:20.335685 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:20.335671    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:33:20.900813 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:20.900778    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm" event={"ID":"3ff63e47-bb00-43eb-98f8-70863329b5e6","Type":"ContainerStarted","Data":"d67577561105d97c581d606dbfe65d7785adc00a0adaa2833aa5a61ad4545879"}
Jul 21 16:33:21.335756 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:21.335712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:21.547591 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:21.547561    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:22.031939 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:22.031904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:23.443187 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:23.443124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:23.637602 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:23.637570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:24.035527 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:24.035485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:24.473484 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:24.473395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:24.867565 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:24.867531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:24.926437 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:24.926400    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm" event={"ID":"3ff63e47-bb00-43eb-98f8-70863329b5e6","Type":"ContainerStarted","Data":"839fde9d5fd6e8c5769f6f720e16fc087f89f5a6bd84db1387e814476ae69936"}
Jul 21 16:33:24.926703 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:24.926498    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:33:24.962003 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:24.961932    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm" podStartSLOduration=2.267903083 podStartE2EDuration="5.961907664s" totalImagesPullingTime="3.694004581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:24.958685029 +0000 UTC m=+327.226677704" watchObservedRunningTime="2026-07-21 16:33:24.961907664 +0000 UTC m=+327.229900336"
Jul 21 16:33:25.074322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:25.074284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:26.120281 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:26.120232    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:26.337292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:26.337258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:35.933161 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:33:35.933123    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54b99c46f6-n6xtm"
Jul 21 16:34:12.507556 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:12.507454    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:12.610194 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:12.610125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:12.700808 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:12.700770    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:13.464617 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:13.464576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:13.622960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:13.622924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:41.707204 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:41.707152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:42.275070 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:42.274984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:42.619575 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:42.619493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:43.337099 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:43.337069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:43.431067 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:43.431019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:46.492227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:46.492190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:46.605329 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:46.605298    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:49.779857 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:49.779825    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:49.888069 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:49.888032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:50.278213 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:50.278151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:50.552462 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:50.552373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:51.638449 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.638416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:51.867468 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.867437    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"]
Jul 21 16:34:51.870708 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.870691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:34:51.873477 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.873455    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:34:51.873583 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.873554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sjv98\""
Jul 21 16:34:51.874502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.874488    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:34:51.884322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:51.884304    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"]
Jul 21 16:34:52.004878 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.004850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srjbd\" (UniqueName: \"kubernetes.io/projected/af9ad917-5ebb-44de-80c8-7a325a43db7c-kube-api-access-srjbd\") pod \"limitador-operator-controller-manager-859d7b78bd-m97zz\" (UID: \"af9ad917-5ebb-44de-80c8-7a325a43db7c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:34:52.105849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.105797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srjbd\" (UniqueName: \"kubernetes.io/projected/af9ad917-5ebb-44de-80c8-7a325a43db7c-kube-api-access-srjbd\") pod \"limitador-operator-controller-manager-859d7b78bd-m97zz\" (UID: \"af9ad917-5ebb-44de-80c8-7a325a43db7c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:34:52.116683 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.116664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srjbd\" (UniqueName: \"kubernetes.io/projected/af9ad917-5ebb-44de-80c8-7a325a43db7c-kube-api-access-srjbd\") pod \"limitador-operator-controller-manager-859d7b78bd-m97zz\" (UID: \"af9ad917-5ebb-44de-80c8-7a325a43db7c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:34:52.180669 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.180638    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:34:52.336412 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.336388    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"]
Jul 21 16:34:52.338901 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:34:52.338869    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9ad917_5ebb_44de_80c8_7a325a43db7c.slice/crio-a1c401bcbdeaf9ea7803566ddb846feccab0498ee09abc0c56b59dc6843ee46b WatchSource:0}: Error finding container a1c401bcbdeaf9ea7803566ddb846feccab0498ee09abc0c56b59dc6843ee46b: Status 404 returned error can't find the container with id a1c401bcbdeaf9ea7803566ddb846feccab0498ee09abc0c56b59dc6843ee46b
Jul 21 16:34:52.505136 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.505104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:52.725588 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:52.725494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:53.310066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:53.310025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz" event={"ID":"af9ad917-5ebb-44de-80c8-7a325a43db7c","Type":"ContainerStarted","Data":"a1c401bcbdeaf9ea7803566ddb846feccab0498ee09abc0c56b59dc6843ee46b"}
Jul 21 16:34:53.312234 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:53.312200    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:53.417579 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:53.417548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:53.512364 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:53.512333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:55.320381 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.320345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz" event={"ID":"af9ad917-5ebb-44de-80c8-7a325a43db7c","Type":"ContainerStarted","Data":"64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9"}
Jul 21 16:34:55.320836 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.320481    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:34:55.336662 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.336614    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz" podStartSLOduration=1.509224271 podStartE2EDuration="4.33659945s" totalImagesPullingTime="2.827375179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:55.335435732 +0000 UTC m=+417.603428410" watchObservedRunningTime="2026-07-21 16:34:55.33659945 +0000 UTC m=+417.604592123"
Jul 21 16:34:55.504962 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.504931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:55.601724 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.601689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:55.894069 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.893980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:55.994221 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:55.994161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:58.295354 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:58.295316    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:58.570120 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:34:58.570033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:00.907558 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:00.907528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:01.016258 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:01.016225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:01.233140 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:01.233057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:06.327627 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:06.327600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:07.962633 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:07.962597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:08.065274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.065239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:08.657206 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.657153    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:08.758129 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.758088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:08.785826 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.785796    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"]
Jul 21 16:35:08.786006 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.785983    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" containerName="manager" containerID="cri-o://64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9" gracePeriod=2
Jul 21 16:35:08.798679 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.798649    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"]
Jul 21 16:35:08.806879 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:35:08.806844    2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"af9ad917-5ebb-44de-80c8-7a325a43db7c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-m97zz\": pods \"limitador-operator-controller-manager-859d7b78bd-m97zz\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:08.817902 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.817871    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"]
Jul 21 16:35:08.818368 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.818349    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" containerName="manager"
Jul 21 16:35:08.818414 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.818373    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" containerName="manager"
Jul 21 16:35:08.818495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.818483    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" containerName="manager"
Jul 21 16:35:08.821711 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.821686    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:08.823743 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:35:08.823717    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m97zz\" is forbidden: User \"system:node:ip-10-0-129-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-98.ec2.internal' and this object" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:08.837719 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.837367    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"]
Jul 21 16:35:08.952321 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:08.952235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk9l7\" (UniqueName: \"kubernetes.io/projected/5a408025-c5e9-48aa-aa2d-6698243523f2-kube-api-access-qk9l7\") pod \"limitador-operator-controller-manager-859d7b78bd-x7w2k\" (UID: \"5a408025-c5e9-48aa-aa2d-6698243523f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:09.025854 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.025832    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:09.031597 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:35:09.031569    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m97zz\" is forbidden: User \"system:node:ip-10-0-129-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-98.ec2.internal' and this object" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:09.053573 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.053545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk9l7\" (UniqueName: \"kubernetes.io/projected/5a408025-c5e9-48aa-aa2d-6698243523f2-kube-api-access-qk9l7\") pod \"limitador-operator-controller-manager-859d7b78bd-x7w2k\" (UID: \"5a408025-c5e9-48aa-aa2d-6698243523f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:09.070261 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.070241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk9l7\" (UniqueName: \"kubernetes.io/projected/5a408025-c5e9-48aa-aa2d-6698243523f2-kube-api-access-qk9l7\") pod \"limitador-operator-controller-manager-859d7b78bd-x7w2k\" (UID: \"5a408025-c5e9-48aa-aa2d-6698243523f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:09.154036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.154008    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srjbd\" (UniqueName: \"kubernetes.io/projected/af9ad917-5ebb-44de-80c8-7a325a43db7c-kube-api-access-srjbd\") pod \"af9ad917-5ebb-44de-80c8-7a325a43db7c\" (UID: \"af9ad917-5ebb-44de-80c8-7a325a43db7c\") "
Jul 21 16:35:09.156450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.156421    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9ad917-5ebb-44de-80c8-7a325a43db7c-kube-api-access-srjbd" (OuterVolumeSpecName: "kube-api-access-srjbd") pod "af9ad917-5ebb-44de-80c8-7a325a43db7c" (UID: "af9ad917-5ebb-44de-80c8-7a325a43db7c"). InnerVolumeSpecName "kube-api-access-srjbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:35:09.160575 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.160550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:09.255722 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.255691    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srjbd\" (UniqueName: \"kubernetes.io/projected/af9ad917-5ebb-44de-80c8-7a325a43db7c-kube-api-access-srjbd\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:35:09.293228 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.293201    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"]
Jul 21 16:35:09.295713 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:35:09.295688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a408025_c5e9_48aa_aa2d_6698243523f2.slice/crio-946c79176ec4b09da42567c51c2becbeb26590fb5e8aa07416741fe5241bd865 WatchSource:0}: Error finding container 946c79176ec4b09da42567c51c2becbeb26590fb5e8aa07416741fe5241bd865: Status 404 returned error can't find the container with id 946c79176ec4b09da42567c51c2becbeb26590fb5e8aa07416741fe5241bd865
Jul 21 16:35:09.380755 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.380715    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k" event={"ID":"5a408025-c5e9-48aa-aa2d-6698243523f2","Type":"ContainerStarted","Data":"1d227ccfe06916fae9e859e1e56a5653a6c5f24fc173e6163bd308c9a68390fe"}
Jul 21 16:35:09.380920 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.380773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k" event={"ID":"5a408025-c5e9-48aa-aa2d-6698243523f2","Type":"ContainerStarted","Data":"946c79176ec4b09da42567c51c2becbeb26590fb5e8aa07416741fe5241bd865"}
Jul 21 16:35:09.380920 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.380892    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:09.382050 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.382028    2575 generic.go:356] "Generic (PLEG): container finished" podID="af9ad917-5ebb-44de-80c8-7a325a43db7c" containerID="64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9" exitCode=0
Jul 21 16:35:09.382137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.382064    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:09.382137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.382082    2575 scope.go:117] "RemoveContainer" containerID="64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9"
Jul 21 16:35:09.382958 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:35:09.382907    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m97zz\" is forbidden: User \"system:node:ip-10-0-129-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-98.ec2.internal' and this object" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:09.390178 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.390150    2575 scope.go:117] "RemoveContainer" containerID="64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9"
Jul 21 16:35:09.390420 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:35:09.390403    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9\": container with ID starting with 64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9 not found: ID does not exist" containerID="64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9"
Jul 21 16:35:09.390467 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.390429    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9"} err="failed to get container status \"64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9\": rpc error: code = NotFound desc = could not find container \"64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9\": container with ID starting with 64c2a95b1a87c7cbe9595b17f687a6a680efabb60a7ee4dcc28a8a2f17026be9 not found: ID does not exist"
Jul 21 16:35:09.411418 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:09.411370    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k" podStartSLOduration=1.411353434 podStartE2EDuration="1.411353434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:09.410098089 +0000 UTC m=+431.678090757" watchObservedRunningTime="2026-07-21 16:35:09.411353434 +0000 UTC m=+431.679346106"
Jul 21 16:35:09.412199 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:35:09.412159    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m97zz\" is forbidden: User \"system:node:ip-10-0-129-98.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-98.ec2.internal' and this object" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m97zz"
Jul 21 16:35:10.244788 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:10.244753    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af9ad917-5ebb-44de-80c8-7a325a43db7c" path="/var/lib/kubelet/pods/af9ad917-5ebb-44de-80c8-7a325a43db7c/volumes"
Jul 21 16:35:10.376931 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:10.376896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:10.474593 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:10.474559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:15.710327 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:15.710289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:15.775844 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:15.775816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:17.426549 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:17.426515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:17.527550 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:17.527522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:20.323884 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:20.323777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:20.389711 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:20.389686    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x7w2k"
Jul 21 16:35:20.413852 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:20.413816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:26.963181 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:26.963133    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:27.064780 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:27.064734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:29.375244 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:29.375213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:29.476159 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:29.476122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:47.687872 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:47.687840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:48.113785 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:48.113751    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:49.390612 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.390574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:49.507594 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.507560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:49.605375 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.605342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:49.838985 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.838955    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:35:49.842051 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.842033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:49.844233 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.844209    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 16:35:49.844348 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.844331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m5hll\""
Jul 21 16:35:49.851660 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.851640    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:35:49.882503 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.882479    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:35:49.883466 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.883450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdh78\" (UniqueName: \"kubernetes.io/projected/94b36d0d-b5d2-4ee1-bd7d-a785146a3aad-kube-api-access-tdh78\") pod \"limitador-limitador-54d6d988d5-mt2sb\" (UID: \"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:49.883525 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.883483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94b36d0d-b5d2-4ee1-bd7d-a785146a3aad-config-file\") pod \"limitador-limitador-54d6d988d5-mt2sb\" (UID: \"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:49.984354 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.984328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94b36d0d-b5d2-4ee1-bd7d-a785146a3aad-config-file\") pod \"limitador-limitador-54d6d988d5-mt2sb\" (UID: \"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:49.984496 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.984388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdh78\" (UniqueName: \"kubernetes.io/projected/94b36d0d-b5d2-4ee1-bd7d-a785146a3aad-kube-api-access-tdh78\") pod \"limitador-limitador-54d6d988d5-mt2sb\" (UID: \"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:49.984905 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.984887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94b36d0d-b5d2-4ee1-bd7d-a785146a3aad-config-file\") pod \"limitador-limitador-54d6d988d5-mt2sb\" (UID: \"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:49.994353 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:49.994328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdh78\" (UniqueName: \"kubernetes.io/projected/94b36d0d-b5d2-4ee1-bd7d-a785146a3aad-kube-api-access-tdh78\") pod \"limitador-limitador-54d6d988d5-mt2sb\" (UID: \"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:50.153264 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:50.153157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:50.241284 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:50.241257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:50.283685 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:50.283661    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:35:50.286114 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:35:50.286089    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b36d0d_b5d2_4ee1_bd7d_a785146a3aad.slice/crio-8999831d005433db0e690d8942a88b62f5b21714e3c71b03352fde3523016a86 WatchSource:0}: Error finding container 8999831d005433db0e690d8942a88b62f5b21714e3c71b03352fde3523016a86: Status 404 returned error can't find the container with id 8999831d005433db0e690d8942a88b62f5b21714e3c71b03352fde3523016a86
Jul 21 16:35:50.342706 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:50.342679    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:50.561909 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:50.561869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb" event={"ID":"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad","Type":"ContainerStarted","Data":"8999831d005433db0e690d8942a88b62f5b21714e3c71b03352fde3523016a86"}
Jul 21 16:35:53.582900 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:53.582870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb" event={"ID":"94b36d0d-b5d2-4ee1-bd7d-a785146a3aad","Type":"ContainerStarted","Data":"481716d1e49d9a951e03733ea578582b13fec926ba5df94ac7125b5173196134"}
Jul 21 16:35:53.583378 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:53.582933    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:35:53.600072 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:35:53.600024    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb" podStartSLOduration=2.123794073 podStartE2EDuration="4.600010274s" totalImagesPullingTime="2.476216201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:53.599054806 +0000 UTC m=+475.867047480" watchObservedRunningTime="2026-07-21 16:35:53.600010274 +0000 UTC m=+475.868002985"
Jul 21 16:36:04.587971 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:04.587942    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"
Jul 21 16:36:10.633750 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:10.633715    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:10.729500 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:10.729463    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:11.080211 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:11.080157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:13.653949 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:13.653913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:13.754928 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:13.754885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:23.971874 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:23.971840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:24.109403 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.109371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:24.478477 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.478441    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7486d79469-xxbx7"]
Jul 21 16:36:24.481757 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.481738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:24.484425 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.484403    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zxr8s\""
Jul 21 16:36:24.493478 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.493452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7486d79469-xxbx7"]
Jul 21 16:36:24.570480 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.570445    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7486d79469-xxbx7"]
Jul 21 16:36:24.570722 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:36:24.570703    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mbf9f], unattached volumes=[], failed to process volumes=[kube-api-access-mbf9f]: context canceled" pod="kuadrant-system/authorino-7486d79469-xxbx7" podUID="b86cbe2f-3960-4999-96c1-faf577b2f76f"
Jul 21 16:36:24.673291 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.673257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbf9f\" (UniqueName: \"kubernetes.io/projected/b86cbe2f-3960-4999-96c1-faf577b2f76f-kube-api-access-mbf9f\") pod \"authorino-7486d79469-xxbx7\" (UID: \"b86cbe2f-3960-4999-96c1-faf577b2f76f\") " pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:24.709352 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.709325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:24.715772 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.715749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:24.774601 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.774567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbf9f\" (UniqueName: \"kubernetes.io/projected/b86cbe2f-3960-4999-96c1-faf577b2f76f-kube-api-access-mbf9f\") pod \"authorino-7486d79469-xxbx7\" (UID: \"b86cbe2f-3960-4999-96c1-faf577b2f76f\") " pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:24.783954 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.783926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbf9f\" (UniqueName: \"kubernetes.io/projected/b86cbe2f-3960-4999-96c1-faf577b2f76f-kube-api-access-mbf9f\") pod \"authorino-7486d79469-xxbx7\" (UID: \"b86cbe2f-3960-4999-96c1-faf577b2f76f\") " pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:24.976960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.976928    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbf9f\" (UniqueName: \"kubernetes.io/projected/b86cbe2f-3960-4999-96c1-faf577b2f76f-kube-api-access-mbf9f\") pod \"b86cbe2f-3960-4999-96c1-faf577b2f76f\" (UID: \"b86cbe2f-3960-4999-96c1-faf577b2f76f\") "
Jul 21 16:36:24.979267 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:24.979236    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86cbe2f-3960-4999-96c1-faf577b2f76f-kube-api-access-mbf9f" (OuterVolumeSpecName: "kube-api-access-mbf9f") pod "b86cbe2f-3960-4999-96c1-faf577b2f76f" (UID: "b86cbe2f-3960-4999-96c1-faf577b2f76f"). InnerVolumeSpecName "kube-api-access-mbf9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:25.078004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:25.077933    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbf9f\" (UniqueName: \"kubernetes.io/projected/b86cbe2f-3960-4999-96c1-faf577b2f76f-kube-api-access-mbf9f\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:36:25.714033 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:25.714002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7486d79469-xxbx7"
Jul 21 16:36:25.754795 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:25.754759    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7486d79469-xxbx7"]
Jul 21 16:36:25.759156 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:25.759130    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7486d79469-xxbx7"]
Jul 21 16:36:26.244765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:26.244732    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86cbe2f-3960-4999-96c1-faf577b2f76f" path="/var/lib/kubelet/pods/b86cbe2f-3960-4999-96c1-faf577b2f76f/volumes"
Jul 21 16:36:30.304520 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.304481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:30.323826 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.323801    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7844b58b7c-c76hl"]
Jul 21 16:36:30.330342 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.330325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.332856 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.332822    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:36:30.332856 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.332856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9gnqm\""
Jul 21 16:36:30.333022 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.332857    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:36:30.336660 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.336638    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7844b58b7c-c76hl"]
Jul 21 16:36:30.405087 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.405032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:30.421911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.421875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnhgf\" (UniqueName: \"kubernetes.io/projected/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-kube-api-access-gnhgf\") pod \"maas-controller-7844b58b7c-c76hl\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") " pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.422042 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.421919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-webhook-cert\") pod \"maas-controller-7844b58b7c-c76hl\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") " pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.493197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.493141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:30.522645 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.522616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnhgf\" (UniqueName: \"kubernetes.io/projected/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-kube-api-access-gnhgf\") pod \"maas-controller-7844b58b7c-c76hl\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") " pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.522813 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.522662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-webhook-cert\") pod \"maas-controller-7844b58b7c-c76hl\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") " pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.525131 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.525103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-webhook-cert\") pod \"maas-controller-7844b58b7c-c76hl\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") " pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.530393 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.530376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnhgf\" (UniqueName: \"kubernetes.io/projected/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-kube-api-access-gnhgf\") pod \"maas-controller-7844b58b7c-c76hl\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") " pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.569581 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.569503    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:30.643554 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.643518    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:30.776123 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:30.776097    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7844b58b7c-c76hl"]
Jul 21 16:36:30.778926 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:36:30.778894    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f900c32_d0d9_4bbe_b533_4fc9a8be5e00.slice/crio-0fce941294ee351ff2c931994e1e1fa8e3fd16d3de8001fa20d44e88be0e96d3 WatchSource:0}: Error finding container 0fce941294ee351ff2c931994e1e1fa8e3fd16d3de8001fa20d44e88be0e96d3: Status 404 returned error can't find the container with id 0fce941294ee351ff2c931994e1e1fa8e3fd16d3de8001fa20d44e88be0e96d3
Jul 21 16:36:31.743723 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:31.743681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7844b58b7c-c76hl" event={"ID":"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00","Type":"ContainerStarted","Data":"0fce941294ee351ff2c931994e1e1fa8e3fd16d3de8001fa20d44e88be0e96d3"}
Jul 21 16:36:33.408429 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:33.408398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:33.518521 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:33.518484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:33.753580 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:33.753549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7844b58b7c-c76hl" event={"ID":"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00","Type":"ContainerStarted","Data":"29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a"}
Jul 21 16:36:33.753740 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:33.753669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:33.783200 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:33.783095    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7844b58b7c-c76hl" podStartSLOduration=1.339109582 podStartE2EDuration="3.783080016s" totalImagesPullingTime="2.443970434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:33.781823349 +0000 UTC m=+516.049816023" watchObservedRunningTime="2026-07-21 16:36:33.783080016 +0000 UTC m=+516.051072687"
Jul 21 16:36:44.760738 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:44.760707    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:44.810431 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:44.810401    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7844b58b7c-c76hl"]
Jul 21 16:36:44.810652 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:44.810613    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7844b58b7c-c76hl" podUID="1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" containerName="manager" containerID="cri-o://29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a" gracePeriod=30
Jul 21 16:36:45.055975 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.055945    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:45.145371 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.145330    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnhgf\" (UniqueName: \"kubernetes.io/projected/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-kube-api-access-gnhgf\") pod \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") "
Jul 21 16:36:45.145528 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.145432    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-webhook-cert\") pod \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\" (UID: \"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00\") "
Jul 21 16:36:45.147753 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.147719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-kube-api-access-gnhgf" (OuterVolumeSpecName: "kube-api-access-gnhgf") pod "1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" (UID: "1f900c32-d0d9-4bbe-b533-4fc9a8be5e00"). InnerVolumeSpecName "kube-api-access-gnhgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:45.147753 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.147725    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" (UID: "1f900c32-d0d9-4bbe-b533-4fc9a8be5e00"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:36:45.246964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.246917    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-webhook-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:36:45.246964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.246959    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnhgf\" (UniqueName: \"kubernetes.io/projected/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00-kube-api-access-gnhgf\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:36:45.808220 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.808160    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" containerID="29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a" exitCode=0
Jul 21 16:36:45.808623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.808232    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7844b58b7c-c76hl"
Jul 21 16:36:45.808623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.808265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7844b58b7c-c76hl" event={"ID":"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00","Type":"ContainerDied","Data":"29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a"}
Jul 21 16:36:45.808623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.808321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7844b58b7c-c76hl" event={"ID":"1f900c32-d0d9-4bbe-b533-4fc9a8be5e00","Type":"ContainerDied","Data":"0fce941294ee351ff2c931994e1e1fa8e3fd16d3de8001fa20d44e88be0e96d3"}
Jul 21 16:36:45.808623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.808344    2575 scope.go:117] "RemoveContainer" containerID="29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a"
Jul 21 16:36:45.817031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.816895    2575 scope.go:117] "RemoveContainer" containerID="29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a"
Jul 21 16:36:45.817219 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:36:45.817195    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a\": container with ID starting with 29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a not found: ID does not exist" containerID="29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a"
Jul 21 16:36:45.817274 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.817230    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a"} err="failed to get container status \"29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a\": rpc error: code = NotFound desc = could not find container \"29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a\": container with ID starting with 29f4210235494d63be3ce532abb3df91c6eaa8b3c2dd46f3195652a967f4122a not found: ID does not exist"
Jul 21 16:36:45.830086 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.830061    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7844b58b7c-c76hl"]
Jul 21 16:36:45.834465 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:45.834444    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7844b58b7c-c76hl"]
Jul 21 16:36:46.245147 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:46.245123    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" path="/var/lib/kubelet/pods/1f900c32-d0d9-4bbe-b533-4fc9a8be5e00/volumes"
Jul 21 16:36:53.489466 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:36:53.489378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:05.499329 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:05.499277    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:05.598185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:05.598134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:06.095278 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.095242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:06.154101 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.154067    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"]
Jul 21 16:37:06.154445 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.154433    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" containerName="manager"
Jul 21 16:37:06.154488 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.154447    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" containerName="manager"
Jul 21 16:37:06.154522 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.154500    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f900c32-d0d9-4bbe-b533-4fc9a8be5e00" containerName="manager"
Jul 21 16:37:06.158589 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.158571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.161377 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.161351    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 16:37:06.162052 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.162025    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9g9wv\""
Jul 21 16:37:06.162197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.162104    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 16:37:06.162197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.162111    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:37:06.169152 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.169127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"]
Jul 21 16:37:06.325580 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.325540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8b5a8e-68ef-4d76-9554-6baae9076d23-maas-api-tls\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.325752 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.325611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkg5v\" (UniqueName: \"kubernetes.io/projected/4a8b5a8e-68ef-4d76-9554-6baae9076d23-kube-api-access-nkg5v\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.325752 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.325694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8b5a8e-68ef-4d76-9554-6baae9076d23-openshift-service-ca\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.426711 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.426621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkg5v\" (UniqueName: \"kubernetes.io/projected/4a8b5a8e-68ef-4d76-9554-6baae9076d23-kube-api-access-nkg5v\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.426711 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.426689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8b5a8e-68ef-4d76-9554-6baae9076d23-openshift-service-ca\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.426892 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.426720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8b5a8e-68ef-4d76-9554-6baae9076d23-maas-api-tls\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.426892 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:37:06.426814    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 21 16:37:06.426892 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:37:06.426870    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8b5a8e-68ef-4d76-9554-6baae9076d23-maas-api-tls podName:4a8b5a8e-68ef-4d76-9554-6baae9076d23 nodeName:}" failed. No retries permitted until 2026-07-21 16:37:06.926852783 +0000 UTC m=+549.194845445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a8b5a8e-68ef-4d76-9554-6baae9076d23-maas-api-tls") pod "maas-api-844568fb96-9n4cq" (UID: "4a8b5a8e-68ef-4d76-9554-6baae9076d23") : secret "maas-api-serving-cert" not found
Jul 21 16:37:06.427393 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.427374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8b5a8e-68ef-4d76-9554-6baae9076d23-openshift-service-ca\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.437440 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.437409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkg5v\" (UniqueName: \"kubernetes.io/projected/4a8b5a8e-68ef-4d76-9554-6baae9076d23-kube-api-access-nkg5v\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.530036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.530002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:06.668473 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.668441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:06.797595 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.797562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:06.851866 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.851834    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:37:06.884928 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.884894    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vm87z"]
Jul 21 16:37:06.887578 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.887562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:06.890393 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.890373    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 16:37:06.890508 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.890373    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6l449\""
Jul 21 16:37:06.900841 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.900821    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vm87z"]
Jul 21 16:37:06.931043 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.931019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8b5a8e-68ef-4d76-9554-6baae9076d23-maas-api-tls\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:06.933440 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:06.933421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a8b5a8e-68ef-4d76-9554-6baae9076d23-maas-api-tls\") pod \"maas-api-844568fb96-9n4cq\" (UID: \"4a8b5a8e-68ef-4d76-9554-6baae9076d23\") " pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:07.031876 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.031834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a686eb97-0c87-4c68-909b-9d964380ce4e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vm87z\" (UID: \"a686eb97-0c87-4c68-909b-9d964380ce4e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.032073 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.031890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcbmj\" (UniqueName: \"kubernetes.io/projected/a686eb97-0c87-4c68-909b-9d964380ce4e-kube-api-access-gcbmj\") pod \"payload-pre-processing-7677b774bb-vm87z\" (UID: \"a686eb97-0c87-4c68-909b-9d964380ce4e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.069282 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.069203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:07.132994 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.132967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbmj\" (UniqueName: \"kubernetes.io/projected/a686eb97-0c87-4c68-909b-9d964380ce4e-kube-api-access-gcbmj\") pod \"payload-pre-processing-7677b774bb-vm87z\" (UID: \"a686eb97-0c87-4c68-909b-9d964380ce4e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.133126 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.133043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a686eb97-0c87-4c68-909b-9d964380ce4e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vm87z\" (UID: \"a686eb97-0c87-4c68-909b-9d964380ce4e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.133654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.133638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a686eb97-0c87-4c68-909b-9d964380ce4e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vm87z\" (UID: \"a686eb97-0c87-4c68-909b-9d964380ce4e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.141113 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.141088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcbmj\" (UniqueName: \"kubernetes.io/projected/a686eb97-0c87-4c68-909b-9d964380ce4e-kube-api-access-gcbmj\") pod \"payload-pre-processing-7677b774bb-vm87z\" (UID: \"a686eb97-0c87-4c68-909b-9d964380ce4e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.199096 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.199058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:07.199815 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.199798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"]
Jul 21 16:37:07.202072 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:37:07.202044    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8b5a8e_68ef_4d76_9554_6baae9076d23.slice/crio-e32de6d6782981e8d6fadd2053fe17d34648285061d13885d64a28ce6ddb8ef7 WatchSource:0}: Error finding container e32de6d6782981e8d6fadd2053fe17d34648285061d13885d64a28ce6ddb8ef7: Status 404 returned error can't find the container with id e32de6d6782981e8d6fadd2053fe17d34648285061d13885d64a28ce6ddb8ef7
Jul 21 16:37:07.327218 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.327189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vm87z"]
Jul 21 16:37:07.329537 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:37:07.329512    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda686eb97_0c87_4c68_909b_9d964380ce4e.slice/crio-f0c73a48301acf8395bbeeccd7e7d69ed8baca410f83574322610ce56a3344c2 WatchSource:0}: Error finding container f0c73a48301acf8395bbeeccd7e7d69ed8baca410f83574322610ce56a3344c2: Status 404 returned error can't find the container with id f0c73a48301acf8395bbeeccd7e7d69ed8baca410f83574322610ce56a3344c2
Jul 21 16:37:07.911502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.911463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq" event={"ID":"4a8b5a8e-68ef-4d76-9554-6baae9076d23","Type":"ContainerStarted","Data":"e32de6d6782981e8d6fadd2053fe17d34648285061d13885d64a28ce6ddb8ef7"}
Jul 21 16:37:07.912877 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:07.912846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z" event={"ID":"a686eb97-0c87-4c68-909b-9d964380ce4e","Type":"ContainerStarted","Data":"f0c73a48301acf8395bbeeccd7e7d69ed8baca410f83574322610ce56a3344c2"}
Jul 21 16:37:09.924541 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:09.924512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq" event={"ID":"4a8b5a8e-68ef-4d76-9554-6baae9076d23","Type":"ContainerStarted","Data":"c315c0acbbf9dab113acb117b2b38782eaf99b61c09b491f3acc2d94112ee89a"}
Jul 21 16:37:09.924989 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:09.924618    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:09.925842 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:09.925817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z" event={"ID":"a686eb97-0c87-4c68-909b-9d964380ce4e","Type":"ContainerStarted","Data":"d8d9d83091b7a30a7afcce0deefc19c86b00763b4f0201bd6877f2ed2330a746"}
Jul 21 16:37:09.925962 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:09.925939    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:09.943333 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:09.943287    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq" podStartSLOduration=1.3572259469999999 podStartE2EDuration="3.943271342s" totalImagesPullingTime="2.586045395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:09.942401092 +0000 UTC m=+552.210393764" watchObservedRunningTime="2026-07-21 16:37:09.943271342 +0000 UTC m=+552.211264014"
Jul 21 16:37:09.960839 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:09.960787    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z" podStartSLOduration=1.492716549 podStartE2EDuration="3.960773584s" totalImagesPullingTime="2.468057035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:09.960100248 +0000 UTC m=+552.228092921" watchObservedRunningTime="2026-07-21 16:37:09.960773584 +0000 UTC m=+552.228766258"
Jul 21 16:37:15.936258 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:15.936230    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-844568fb96-9n4cq"
Jul 21 16:37:16.923610 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:16.923572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:17.019839 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:17.019798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:20.933276 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:20.933246    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vm87z"
Jul 21 16:37:34.210566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:34.210532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:34.775947 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:34.775914    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:37:47.007644 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:47.007608    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:47.762109 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:47.762067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:37:55.620495 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:55.620458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:56.937798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:56.937762    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:37:57.777584 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.777553    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"]
Jul 21 16:37:57.780050 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.780033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.784290 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.782714    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fg4kl\""
Jul 21 16:37:57.784290 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.782826    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 16:37:57.784290 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.783601    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 16:37:57.784290 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.783866    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 16:37:57.795196 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.795156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"]
Jul 21 16:37:57.837794 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.837773    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:57.839781 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.839759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.839875 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.839792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.840000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.839871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkghs\" (UniqueName: \"kubernetes.io/projected/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-kube-api-access-pkghs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.840000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.839909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.840000 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.839953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.840116 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.840007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.940673 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.940647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.940680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.940706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.940724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.940755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkghs\" (UniqueName: \"kubernetes.io/projected/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-kube-api-access-pkghs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941036 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.940871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.941079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.941131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.941283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.941161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.943082 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.943063    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.943498 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.943479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:57.951994 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:57.951975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkghs\" (UniqueName: \"kubernetes.io/projected/bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd-kube-api-access-pkghs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h\" (UID: \"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:58.094740 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:58.094669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:37:58.186972 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:58.186947    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:37:58.187480 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:58.187464    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:37:58.236071 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:58.236046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"]
Jul 21 16:37:58.237779 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:37:58.237747    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf476e2e_dec3_4ecf_bcbb_ea4fff3100fd.slice/crio-3b9999e67766866f35a977c660b672b203ae2877e5ccc38644e48e597e41e2fa WatchSource:0}: Error finding container 3b9999e67766866f35a977c660b672b203ae2877e5ccc38644e48e597e41e2fa: Status 404 returned error can't find the container with id 3b9999e67766866f35a977c660b672b203ae2877e5ccc38644e48e597e41e2fa
Jul 21 16:37:59.141944 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:37:59.141905    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h" event={"ID":"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd","Type":"ContainerStarted","Data":"3b9999e67766866f35a977c660b672b203ae2877e5ccc38644e48e597e41e2fa"}
Jul 21 16:38:00.147282 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:00.147255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h" event={"ID":"bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd","Type":"ContainerStarted","Data":"71e7a173cd1772699986859ce89be81fd7ac2eb7c1e38494a83b68a8b8bc806e"}
Jul 21 16:38:00.163998 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:00.163951    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h" podStartSLOduration=2.154114075 podStartE2EDuration="3.163935772s" totalImagesPullingTime="1.009821697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:38:00.16340995 +0000 UTC m=+602.431402622" watchObservedRunningTime="2026-07-21 16:38:00.163935772 +0000 UTC m=+602.431928444"
Jul 21 16:38:00.422991 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:00.422903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:00.523982 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:00.523945    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:02.568652 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:02.568617    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:38:07.308571 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:07.308526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:08.094799 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:08.094762    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:38:08.094962 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:08.094816    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:38:08.107216 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:08.107189    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:38:08.193515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:08.193491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h"
Jul 21 16:38:09.972181 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:09.972143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:38:12.288960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.288931    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"]
Jul 21 16:38:12.292229 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.292212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.296127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.296107    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 16:38:12.307127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.307105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"]
Jul 21 16:38:12.354993 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.354972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:12.460395 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.460368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.460395 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.460393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.460541 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.460413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7deb25-b2a6-4595-9598-ccea7d80ce03-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.460541 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.460466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fbg\" (UniqueName: \"kubernetes.io/projected/6b7deb25-b2a6-4595-9598-ccea7d80ce03-kube-api-access-d6fbg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.460604 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.460550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.460604 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.460586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.561657 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.561595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.561657 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.561629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.561816 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.561678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.561816 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.561700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.561816 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.561723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7deb25-b2a6-4595-9598-ccea7d80ce03-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.561816 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.561765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fbg\" (UniqueName: \"kubernetes.io/projected/6b7deb25-b2a6-4595-9598-ccea7d80ce03-kube-api-access-d6fbg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.562069 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.562049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.562135 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.562090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.562209 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.562187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.563985 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.563961    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b7deb25-b2a6-4595-9598-ccea7d80ce03-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.564252 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.564235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b7deb25-b2a6-4595-9598-ccea7d80ce03-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.569979 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.569962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fbg\" (UniqueName: \"kubernetes.io/projected/6b7deb25-b2a6-4595-9598-ccea7d80ce03-kube-api-access-d6fbg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-m8677\" (UID: \"6b7deb25-b2a6-4595-9598-ccea7d80ce03\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.600587 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.600566    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:12.729800 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:12.729776    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"]
Jul 21 16:38:12.732140 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:38:12.732102    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b7deb25_b2a6_4595_9598_ccea7d80ce03.slice/crio-db1c8b996eebf71dcbadf2a6c46ba714b86253546be930d548b1d706217f38ed WatchSource:0}: Error finding container db1c8b996eebf71dcbadf2a6c46ba714b86253546be930d548b1d706217f38ed: Status 404 returned error can't find the container with id db1c8b996eebf71dcbadf2a6c46ba714b86253546be930d548b1d706217f38ed
Jul 21 16:38:13.206306 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:13.206229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677" event={"ID":"6b7deb25-b2a6-4595-9598-ccea7d80ce03","Type":"ContainerStarted","Data":"c30688112db8a11401f8774eae9f5e0d7ebfa3594e5c7808924e82a7a0dfed91"}
Jul 21 16:38:13.206306 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:13.206275    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677" event={"ID":"6b7deb25-b2a6-4595-9598-ccea7d80ce03","Type":"ContainerStarted","Data":"db1c8b996eebf71dcbadf2a6c46ba714b86253546be930d548b1d706217f38ed"}
Jul 21 16:38:13.224215 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:13.224147    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677" podStartSLOduration=1.042064972 podStartE2EDuration="1.224132733s" totalImagesPullingTime="182.067761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:38:13.222295109 +0000 UTC m=+615.490287782" watchObservedRunningTime="2026-07-21 16:38:13.224132733 +0000 UTC m=+615.492125404"
Jul 21 16:38:16.866403 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:16.866365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:21.886268 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:21.886186    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:38:22.601025 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:22.600981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:22.601240 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:22.601117    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:22.613184 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:22.613150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:38:23.265312 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:38:23.265274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-m8677"
Jul 21 16:39:20.226147 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:20.226110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:20.311641 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:20.311612    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:21.508295 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:21.508246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:21.868989 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:21.868916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:37.230263 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:37.230221    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:47.371115 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:47.371075    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:39:59.163379 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:39:59.163286    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:40:06.571389 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:40:06.571354    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:40:18.861906 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:40:18.861867    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:41:11.889481 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:11.889446    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57669fdb4c-tfjr6"]
Jul 21 16:41:11.892701 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:11.892684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:11.895150 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:11.895113    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:41:11.895985 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:11.895969    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9gnqm\""
Jul 21 16:41:11.895985 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:11.895978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:41:11.900619 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:11.900479    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-tfjr6"]
Jul 21 16:41:12.038503 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.038470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/813d5fff-79eb-45af-9afa-c3eddab26330-webhook-cert\") pod \"maas-controller-57669fdb4c-tfjr6\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") " pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.038660 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.038518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg84c\" (UniqueName: \"kubernetes.io/projected/813d5fff-79eb-45af-9afa-c3eddab26330-kube-api-access-pg84c\") pod \"maas-controller-57669fdb4c-tfjr6\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") " pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.139185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.139135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg84c\" (UniqueName: \"kubernetes.io/projected/813d5fff-79eb-45af-9afa-c3eddab26330-kube-api-access-pg84c\") pod \"maas-controller-57669fdb4c-tfjr6\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") " pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.139335 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.139295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/813d5fff-79eb-45af-9afa-c3eddab26330-webhook-cert\") pod \"maas-controller-57669fdb4c-tfjr6\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") " pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.141892 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.141833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/813d5fff-79eb-45af-9afa-c3eddab26330-webhook-cert\") pod \"maas-controller-57669fdb4c-tfjr6\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") " pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.152195 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.152148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg84c\" (UniqueName: \"kubernetes.io/projected/813d5fff-79eb-45af-9afa-c3eddab26330-kube-api-access-pg84c\") pod \"maas-controller-57669fdb4c-tfjr6\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") " pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.205046 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.205006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:12.348401 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.342078    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-tfjr6"]
Jul 21 16:41:12.349432 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:12.349409    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:41:13.002104 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:13.002062    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-tfjr6" event={"ID":"813d5fff-79eb-45af-9afa-c3eddab26330","Type":"ContainerStarted","Data":"9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360"}
Jul 21 16:41:13.002535 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:13.002112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-tfjr6" event={"ID":"813d5fff-79eb-45af-9afa-c3eddab26330","Type":"ContainerStarted","Data":"b8770961b99fb1bfd7b78f1fce19e27bfea243405dd8e12235896b37a8730eb2"}
Jul 21 16:41:13.002535 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:13.002235    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:13.019475 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:13.019426    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57669fdb4c-tfjr6" podStartSLOduration=1.521095736 podStartE2EDuration="2.019410759s" totalImagesPullingTime="498.315023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:41:13.01814261 +0000 UTC m=+795.286135284" watchObservedRunningTime="2026-07-21 16:41:13.019410759 +0000 UTC m=+795.287403453"
Jul 21 16:41:24.009127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:24.009050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:28.639527 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.639497    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-tfjr6"]
Jul 21 16:41:28.639948 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.639708    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57669fdb4c-tfjr6" podUID="813d5fff-79eb-45af-9afa-c3eddab26330" containerName="manager" containerID="cri-o://9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360" gracePeriod=30
Jul 21 16:41:28.887507 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.887481    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:28.910144 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.910083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:41:28.987897 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.987870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/813d5fff-79eb-45af-9afa-c3eddab26330-webhook-cert\") pod \"813d5fff-79eb-45af-9afa-c3eddab26330\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") "
Jul 21 16:41:28.988052 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.987948    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg84c\" (UniqueName: \"kubernetes.io/projected/813d5fff-79eb-45af-9afa-c3eddab26330-kube-api-access-pg84c\") pod \"813d5fff-79eb-45af-9afa-c3eddab26330\" (UID: \"813d5fff-79eb-45af-9afa-c3eddab26330\") "
Jul 21 16:41:28.989968 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.989934    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813d5fff-79eb-45af-9afa-c3eddab26330-kube-api-access-pg84c" (OuterVolumeSpecName: "kube-api-access-pg84c") pod "813d5fff-79eb-45af-9afa-c3eddab26330" (UID: "813d5fff-79eb-45af-9afa-c3eddab26330"). InnerVolumeSpecName "kube-api-access-pg84c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:41:28.990077 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:28.989990    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813d5fff-79eb-45af-9afa-c3eddab26330-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "813d5fff-79eb-45af-9afa-c3eddab26330" (UID: "813d5fff-79eb-45af-9afa-c3eddab26330"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:41:29.074410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.074375    2575 generic.go:356] "Generic (PLEG): container finished" podID="813d5fff-79eb-45af-9afa-c3eddab26330" containerID="9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360" exitCode=0
Jul 21 16:41:29.074591 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.074427    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-tfjr6"
Jul 21 16:41:29.074591 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.074415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-tfjr6" event={"ID":"813d5fff-79eb-45af-9afa-c3eddab26330","Type":"ContainerDied","Data":"9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360"}
Jul 21 16:41:29.074591 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.074562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-tfjr6" event={"ID":"813d5fff-79eb-45af-9afa-c3eddab26330","Type":"ContainerDied","Data":"b8770961b99fb1bfd7b78f1fce19e27bfea243405dd8e12235896b37a8730eb2"}
Jul 21 16:41:29.074591 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.074586    2575 scope.go:117] "RemoveContainer" containerID="9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360"
Jul 21 16:41:29.085376 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.085351    2575 scope.go:117] "RemoveContainer" containerID="9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360"
Jul 21 16:41:29.085736 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:41:29.085697    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360\": container with ID starting with 9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360 not found: ID does not exist" containerID="9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360"
Jul 21 16:41:29.085828 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.085748    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360"} err="failed to get container status \"9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360\": rpc error: code = NotFound desc = could not find container \"9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360\": container with ID starting with 9c480f77c4fe481759f00c6b84e395b0d8139aec26e02bcdc3590d2f7b5a4360 not found: ID does not exist"
Jul 21 16:41:29.089358 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.089338    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg84c\" (UniqueName: \"kubernetes.io/projected/813d5fff-79eb-45af-9afa-c3eddab26330-kube-api-access-pg84c\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:41:29.089358 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.089361    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/813d5fff-79eb-45af-9afa-c3eddab26330-webhook-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:41:29.094719 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.094697    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-tfjr6"]
Jul 21 16:41:29.097811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.097789    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-tfjr6"]
Jul 21 16:41:29.782452 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.782416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:41:29.894819 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.894788    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57669fdb4c-bjmj8"]
Jul 21 16:41:29.895276 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.895259    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813d5fff-79eb-45af-9afa-c3eddab26330" containerName="manager"
Jul 21 16:41:29.895322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.895277    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="813d5fff-79eb-45af-9afa-c3eddab26330" containerName="manager"
Jul 21 16:41:29.895355 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.895346    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="813d5fff-79eb-45af-9afa-c3eddab26330" containerName="manager"
Jul 21 16:41:29.899427 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.899410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:29.901997 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.901978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9gnqm\""
Jul 21 16:41:29.902709 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.902693    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:41:29.902802 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.902697    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:41:29.906384 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.906361    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-bjmj8"]
Jul 21 16:41:29.996107 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.996066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49689\" (UniqueName: \"kubernetes.io/projected/8322f46a-57fb-47c3-96de-26b2e442fd60-kube-api-access-49689\") pod \"maas-controller-57669fdb4c-bjmj8\" (UID: \"8322f46a-57fb-47c3-96de-26b2e442fd60\") " pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:29.996304 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:29.996133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8322f46a-57fb-47c3-96de-26b2e442fd60-webhook-cert\") pod \"maas-controller-57669fdb4c-bjmj8\" (UID: \"8322f46a-57fb-47c3-96de-26b2e442fd60\") " pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:30.097520 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.097417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8322f46a-57fb-47c3-96de-26b2e442fd60-webhook-cert\") pod \"maas-controller-57669fdb4c-bjmj8\" (UID: \"8322f46a-57fb-47c3-96de-26b2e442fd60\") " pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:30.097520 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.097514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49689\" (UniqueName: \"kubernetes.io/projected/8322f46a-57fb-47c3-96de-26b2e442fd60-kube-api-access-49689\") pod \"maas-controller-57669fdb4c-bjmj8\" (UID: \"8322f46a-57fb-47c3-96de-26b2e442fd60\") " pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:30.099986 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.099960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8322f46a-57fb-47c3-96de-26b2e442fd60-webhook-cert\") pod \"maas-controller-57669fdb4c-bjmj8\" (UID: \"8322f46a-57fb-47c3-96de-26b2e442fd60\") " pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:30.107284 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.107256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49689\" (UniqueName: \"kubernetes.io/projected/8322f46a-57fb-47c3-96de-26b2e442fd60-kube-api-access-49689\") pod \"maas-controller-57669fdb4c-bjmj8\" (UID: \"8322f46a-57fb-47c3-96de-26b2e442fd60\") " pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:30.211542 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.211506    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:30.244585 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.244553    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="813d5fff-79eb-45af-9afa-c3eddab26330" path="/var/lib/kubelet/pods/813d5fff-79eb-45af-9afa-c3eddab26330/volumes"
Jul 21 16:41:30.340091 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:30.340069    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-bjmj8"]
Jul 21 16:41:30.342238 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:41:30.342211    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8322f46a_57fb_47c3_96de_26b2e442fd60.slice/crio-5b39a72347949ee570804662f3c01d0a1a0f40d095584591d1fc49084361eb49 WatchSource:0}: Error finding container 5b39a72347949ee570804662f3c01d0a1a0f40d095584591d1fc49084361eb49: Status 404 returned error can't find the container with id 5b39a72347949ee570804662f3c01d0a1a0f40d095584591d1fc49084361eb49
Jul 21 16:41:31.085568 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:31.085536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-bjmj8" event={"ID":"8322f46a-57fb-47c3-96de-26b2e442fd60","Type":"ContainerStarted","Data":"17dddb63404c96c3b0b6e133054e59ee4bc765503c59247def64d578049c87fe"}
Jul 21 16:41:31.085945 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:31.085592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-bjmj8" event={"ID":"8322f46a-57fb-47c3-96de-26b2e442fd60","Type":"ContainerStarted","Data":"5b39a72347949ee570804662f3c01d0a1a0f40d095584591d1fc49084361eb49"}
Jul 21 16:41:31.085945 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:31.085620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:31.104318 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:31.104275    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57669fdb4c-bjmj8" podStartSLOduration=1.5883896210000001 podStartE2EDuration="2.104260777s" totalImagesPullingTime="515.871156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:41:31.102336354 +0000 UTC m=+813.370329026" watchObservedRunningTime="2026-07-21 16:41:31.104260777 +0000 UTC m=+813.372253450"
Jul 21 16:41:42.092487 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:42.092459    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57669fdb4c-bjmj8"
Jul 21 16:41:43.259543 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:43.259505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:41:43.316246 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:43.316210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:41:54.974596 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:41:54.974559    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:42:02.971550 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:02.968520    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:42:05.264187 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:05.264143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:05.368633 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:05.368603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:05.493107 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:05.493080    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:11.187397 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:11.187365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:11.249587 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:11.249552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:11.357922 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:11.357886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:11.614766 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:11.614736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:17.426008 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:17.425978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:17.510059 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:17.510028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:34.780423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:34.780384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:42:43.339819 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:43.339784    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:43.403381 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:43.403333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:43.762688 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:43.762656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:42:52.658109 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:52.658034    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:42:58.216571 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:58.216544    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:42:58.217496 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:42:58.217475    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:43:01.864255 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:43:01.864220    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:43:12.575031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:43:12.575004    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:43:24.171789 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:43:24.171753    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:43:34.889180 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:43:34.889143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:43:44.770566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:43:44.770528    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:44:06.863698 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:44:06.863663    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:44:18.876081 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:44:18.876044    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:44:30.179062 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:44:30.179025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:44:39.899876 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:44:39.899846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:44:44.076268 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:44:44.076235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:44:55.272267 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:44:55.272233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:45:09.671291 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:45:09.671255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:45:20.977422 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:45:20.977376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:45:36.270574 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:45:36.270539    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:45:59.402843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:45:59.402770    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:47:38.175664 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:47:38.175576    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:47:47.372027 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:47:47.371991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:47:58.244617 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:47:58.244588    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:47:58.247078 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:47:58.247057    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:48:00.567064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:48:00.567030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:48:12.639104 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:48:12.639068    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:48:22.377317 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:48:22.377276    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:48:34.279469 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:48:34.279420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:48:42.375965 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:48:42.375927    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:48:53.470513 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:48:53.470427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:49:05.468479 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:49:05.468438    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:49:13.875978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:49:13.875944    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:49:24.979524 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:49:24.979489    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:49:46.263486 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:49:46.263446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:49:56.118044 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:49:56.118004    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:50:02.689668 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.689635    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"]
Jul 21 16:50:02.692884 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.692868    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.695783 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.695758    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-bd6e2e2a-kserve-self-signed-certs\""
Jul 21 16:50:02.719839 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.719765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"]
Jul 21 16:50:02.785795 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.785752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-home\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.785974 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.785807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn8sd\" (UniqueName: \"kubernetes.io/projected/5513fe21-9541-4e2e-8283-697f113f7ee3-kube-api-access-vn8sd\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.785974 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.785911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5513fe21-9541-4e2e-8283-697f113f7ee3-tls-certs\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.785974 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.785953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-tmp-dir\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.786076 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.786026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-dshm\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.786076 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.786064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-model-cache\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.822333 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.822299    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:02.887407 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-tmp-dir\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-dshm\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-model-cache\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-home\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn8sd\" (UniqueName: \"kubernetes.io/projected/5513fe21-9541-4e2e-8283-697f113f7ee3-kube-api-access-vn8sd\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5513fe21-9541-4e2e-8283-697f113f7ee3-tls-certs\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887864 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-tmp-dir\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887928 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-model-cache\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.887976 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.887920    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-home\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.889921 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.889895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-dshm\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.890193 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.890155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5513fe21-9541-4e2e-8283-697f113f7ee3-tls-certs\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:02.900472 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:02.900449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn8sd\" (UniqueName: \"kubernetes.io/projected/5513fe21-9541-4e2e-8283-697f113f7ee3-kube-api-access-vn8sd\") pod \"e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") " pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:03.002978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:03.002944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:03.151599 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:03.151564    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"]
Jul 21 16:50:03.155260 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:50:03.155231    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5513fe21_9541_4e2e_8283_697f113f7ee3.slice/crio-5c0099bf969f1cfdbea9bba45e397bff1d99158872b86d4fcf62e67ad22d1138 WatchSource:0}: Error finding container 5c0099bf969f1cfdbea9bba45e397bff1d99158872b86d4fcf62e67ad22d1138: Status 404 returned error can't find the container with id 5c0099bf969f1cfdbea9bba45e397bff1d99158872b86d4fcf62e67ad22d1138
Jul 21 16:50:03.425973 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:03.425877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4" event={"ID":"5513fe21-9541-4e2e-8283-697f113f7ee3","Type":"ContainerStarted","Data":"befebf21a4654adc12d3f3b4c9cde12f4156087850c75a10db03b07c932e166b"}
Jul 21 16:50:03.425973 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:03.425922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4" event={"ID":"5513fe21-9541-4e2e-8283-697f113f7ee3","Type":"ContainerStarted","Data":"5c0099bf969f1cfdbea9bba45e397bff1d99158872b86d4fcf62e67ad22d1138"}
Jul 21 16:50:03.448743 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:03.448686    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4" podStartSLOduration=1.448668753 podStartE2EDuration="1.448668753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:50:03.447845947 +0000 UTC m=+1325.715838625" watchObservedRunningTime="2026-07-21 16:50:03.448668753 +0000 UTC m=+1325.716661424"
Jul 21 16:50:06.671557 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:06.671521    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:50:13.003930 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:13.003893    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:13.004351 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:13.003956    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:13.016829 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:13.016799    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:13.482588 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:13.482486    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:50:18.683890 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:18.683851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:24.074569 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:24.074531    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:50:49.524807 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:49.524772    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"]
Jul 21 16:50:49.608960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:49.608925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:50.519938 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:50.519901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:53.668799 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:50:53.668765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:51:04.545862 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.545811    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4" podUID="5513fe21-9541-4e2e-8283-697f113f7ee3" containerName="main" containerID="cri-o://befebf21a4654adc12d3f3b4c9cde12f4156087850c75a10db03b07c932e166b" gracePeriod=45
Jul 21 16:51:04.710597 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.710563    2575 generic.go:356] "Generic (PLEG): container finished" podID="5513fe21-9541-4e2e-8283-697f113f7ee3" containerID="befebf21a4654adc12d3f3b4c9cde12f4156087850c75a10db03b07c932e166b" exitCode=0
Jul 21 16:51:04.710746 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.710641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4" event={"ID":"5513fe21-9541-4e2e-8283-697f113f7ee3","Type":"ContainerDied","Data":"befebf21a4654adc12d3f3b4c9cde12f4156087850c75a10db03b07c932e166b"}
Jul 21 16:51:04.795900 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.795833    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:51:04.933352 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-dshm\") pod \"5513fe21-9541-4e2e-8283-697f113f7ee3\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") "
Jul 21 16:51:04.933611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933397    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-tmp-dir\") pod \"5513fe21-9541-4e2e-8283-697f113f7ee3\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") "
Jul 21 16:51:04.933611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5513fe21-9541-4e2e-8283-697f113f7ee3-tls-certs\") pod \"5513fe21-9541-4e2e-8283-697f113f7ee3\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") "
Jul 21 16:51:04.933611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933481    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn8sd\" (UniqueName: \"kubernetes.io/projected/5513fe21-9541-4e2e-8283-697f113f7ee3-kube-api-access-vn8sd\") pod \"5513fe21-9541-4e2e-8283-697f113f7ee3\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") "
Jul 21 16:51:04.933611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933504    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-model-cache\") pod \"5513fe21-9541-4e2e-8283-697f113f7ee3\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") "
Jul 21 16:51:04.933611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933545    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-home\") pod \"5513fe21-9541-4e2e-8283-697f113f7ee3\" (UID: \"5513fe21-9541-4e2e-8283-697f113f7ee3\") "
Jul 21 16:51:04.933912 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5513fe21-9541-4e2e-8283-697f113f7ee3" (UID: "5513fe21-9541-4e2e-8283-697f113f7ee3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:04.933912 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933755    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-model-cache" (OuterVolumeSpecName: "model-cache") pod "5513fe21-9541-4e2e-8283-697f113f7ee3" (UID: "5513fe21-9541-4e2e-8283-697f113f7ee3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:04.933912 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933872    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-tmp-dir\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:51:04.933912 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933891    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-model-cache\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:51:04.933912 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.933869    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-home" (OuterVolumeSpecName: "home") pod "5513fe21-9541-4e2e-8283-697f113f7ee3" (UID: "5513fe21-9541-4e2e-8283-697f113f7ee3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:04.935808 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.935780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5513fe21-9541-4e2e-8283-697f113f7ee3-kube-api-access-vn8sd" (OuterVolumeSpecName: "kube-api-access-vn8sd") pod "5513fe21-9541-4e2e-8283-697f113f7ee3" (UID: "5513fe21-9541-4e2e-8283-697f113f7ee3"). InnerVolumeSpecName "kube-api-access-vn8sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:51:04.935895 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.935780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-dshm" (OuterVolumeSpecName: "dshm") pod "5513fe21-9541-4e2e-8283-697f113f7ee3" (UID: "5513fe21-9541-4e2e-8283-697f113f7ee3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:51:04.935895 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:04.935827    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5513fe21-9541-4e2e-8283-697f113f7ee3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5513fe21-9541-4e2e-8283-697f113f7ee3" (UID: "5513fe21-9541-4e2e-8283-697f113f7ee3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:51:05.034653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.034612    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5513fe21-9541-4e2e-8283-697f113f7ee3-tls-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:51:05.034653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.034645    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn8sd\" (UniqueName: \"kubernetes.io/projected/5513fe21-9541-4e2e-8283-697f113f7ee3-kube-api-access-vn8sd\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:51:05.034653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.034655    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-home\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:51:05.034653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.034663    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5513fe21-9541-4e2e-8283-697f113f7ee3-dshm\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:51:05.715841 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.715812    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"
Jul 21 16:51:05.716305 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.715847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4" event={"ID":"5513fe21-9541-4e2e-8283-697f113f7ee3","Type":"ContainerDied","Data":"5c0099bf969f1cfdbea9bba45e397bff1d99158872b86d4fcf62e67ad22d1138"}
Jul 21 16:51:05.716305 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.715895    2575 scope.go:117] "RemoveContainer" containerID="befebf21a4654adc12d3f3b4c9cde12f4156087850c75a10db03b07c932e166b"
Jul 21 16:51:05.737238 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.737199    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"]
Jul 21 16:51:05.741385 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:05.741360    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-bd6e2e2a-kserve-77fd687f5-kd9n4"]
Jul 21 16:51:06.245565 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:06.245525    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5513fe21-9541-4e2e-8283-697f113f7ee3" path="/var/lib/kubelet/pods/5513fe21-9541-4e2e-8283-697f113f7ee3/volumes"
Jul 21 16:51:07.095728 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:07.095692    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:51:13.971490 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:13.971452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:51:16.299148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:16.299105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:17.437381 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:17.437348    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:30.980487 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:30.980450    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:51:45.371489 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:45.371459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:51:54.373081 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:51:54.372999    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:52:07.577862 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:07.574831    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:52:17.077149 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:17.077111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:52:30.177292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:30.177258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:52:39.286768 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:39.286734    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:52:49.267661 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:49.267626    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:52:58.270818 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:58.270790    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:52:58.273235 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:52:58.273215    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:53:00.777211 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:00.777173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:53:12.963401 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:12.963359    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:53:15.562881 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:15.562847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:21.928489 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:21.928415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:53:33.887478 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:33.887443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:53:43.970665 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:43.970627    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:53:45.135836 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:45.135800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:45.235247 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:45.235220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:53.169315 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:53.169283    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:53:59.571257 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:53:59.571228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:54:02.136902 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:02.136868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:13.977011 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:13.976976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:54:23.468862 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:23.468828    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:23.669256 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:23.669228    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:54:26.458181 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:26.458139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:26.562237 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:26.562206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:26.947573 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:26.947538    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:32.810071 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:32.810044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:32.892580 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:32.892548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.065442 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.065366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.419191 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.419090    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"]
Jul 21 16:54:33.419469 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.419456    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5513fe21-9541-4e2e-8283-697f113f7ee3" containerName="main"
Jul 21 16:54:33.419526 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.419470    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5513fe21-9541-4e2e-8283-697f113f7ee3" containerName="main"
Jul 21 16:54:33.419564 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.419528    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5513fe21-9541-4e2e-8283-697f113f7ee3" containerName="main"
Jul 21 16:54:33.422368 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.422352    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.425545 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.425521    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6a668444-openshift-default-dockercfg-9c98k\""
Jul 21 16:54:33.425953 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.425936    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 16:54:33.430317 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.430293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.460066 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.460039    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"]
Jul 21 16:54:33.493996 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.493968    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:54:33.535500 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-envoy\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535626 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istiod-ca-cert\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535626 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-socket\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535626 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-certs\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-credential-socket\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7546w\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-kube-api-access-7546w\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535726 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-podinfo\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535855 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-token\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.535855 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.535793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-data\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.605152 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.605126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.636559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-credential-socket\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7546w\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-kube-api-access-7546w\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636705 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-podinfo\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636705 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-token\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636705 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-data\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636896 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-envoy\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636896 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istiod-ca-cert\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636896 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-socket\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.636896 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.636828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-certs\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.637100 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.637045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-credential-socket\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.637100 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.637078    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-data\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.637685 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.637657    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istiod-ca-cert\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.637795 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.637745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-certs\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.637795 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.637758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-socket\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.639240 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.639216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-envoy\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.639469 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.639454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-podinfo\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.656250 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.656233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-token\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.662397 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.662374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7546w\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-kube-api-access-7546w\") pod \"e2e-ait-6a668444-openshift-default-77cf68f-wfftc\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") " pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.733264 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.733184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:33.885964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.885941    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"]
Jul 21 16:54:33.888225 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:54:33.888201    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b78e8af_37f3_41b1_8851_ddfb1d8f0077.slice/crio-304d5a7fe2397cd2390082b86b7dfd0ad18f842467965a184fa0a8403f6b88ca WatchSource:0}: Error finding container 304d5a7fe2397cd2390082b86b7dfd0ad18f842467965a184fa0a8403f6b88ca: Status 404 returned error can't find the container with id 304d5a7fe2397cd2390082b86b7dfd0ad18f842467965a184fa0a8403f6b88ca
Jul 21 16:54:33.890127 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:33.890115    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:54:34.682264 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:34.682192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" event={"ID":"7b78e8af-37f3-41b1-8851-ddfb1d8f0077","Type":"ContainerStarted","Data":"304d5a7fe2397cd2390082b86b7dfd0ad18f842467965a184fa0a8403f6b88ca"}
Jul 21 16:54:36.535191 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:36.535131    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:54:36.535474 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:36.535235    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:54:36.535474 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:36.535264    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:54:36.697077 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:36.697041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" event={"ID":"7b78e8af-37f3-41b1-8851-ddfb1d8f0077","Type":"ContainerStarted","Data":"e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"}
Jul 21 16:54:36.723530 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:36.723469    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" podStartSLOduration=1.078893203 podStartE2EDuration="3.72345281s" totalImagesPullingTime="2.644559607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:54:36.721990444 +0000 UTC m=+1598.989983119" watchObservedRunningTime="2026-07-21 16:54:36.72345281 +0000 UTC m=+1598.991445483"
Jul 21 16:54:36.733436 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:36.733403    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:37.739306 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:37.739273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:38.089975 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.089937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:38.182453 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.182427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:38.188278 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.188252    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"]
Jul 21 16:54:38.191615 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.191598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.194906 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.194884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6a668444-serving-cert\""
Jul 21 16:54:38.206488 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.206464    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"]
Jul 21 16:54:38.299268 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.299241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:38.379369 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.379282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b784a43-78b7-4238-b297-5961496da2c9-maas-api-tls\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.379527 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.379427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b784a43-78b7-4238-b297-5961496da2c9-openshift-service-ca\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.379527 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.379465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfvdn\" (UniqueName: \"kubernetes.io/projected/8b784a43-78b7-4238-b297-5961496da2c9-kube-api-access-zfvdn\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.407096 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.407053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:38.479994 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.479960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b784a43-78b7-4238-b297-5961496da2c9-maas-api-tls\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.480157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.480018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b784a43-78b7-4238-b297-5961496da2c9-openshift-service-ca\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.480157 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.480044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfvdn\" (UniqueName: \"kubernetes.io/projected/8b784a43-78b7-4238-b297-5961496da2c9-kube-api-access-zfvdn\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.480831 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.480752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b784a43-78b7-4238-b297-5961496da2c9-openshift-service-ca\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.482554 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.482532    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b784a43-78b7-4238-b297-5961496da2c9-maas-api-tls\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.490919 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.490897    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfvdn\" (UniqueName: \"kubernetes.io/projected/8b784a43-78b7-4238-b297-5961496da2c9-kube-api-access-zfvdn\") pod \"maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.502609 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.502587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:38.645118 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.645027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"]
Jul 21 16:54:38.647779 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:54:38.647751    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b784a43_78b7_4238_b297_5961496da2c9.slice/crio-e7a702083d26c8acf605af03565f40bef5dcdff74edbc854f24e7a6f8e4f5340 WatchSource:0}: Error finding container e7a702083d26c8acf605af03565f40bef5dcdff74edbc854f24e7a6f8e4f5340: Status 404 returned error can't find the container with id e7a702083d26c8acf605af03565f40bef5dcdff74edbc854f24e7a6f8e4f5340
Jul 21 16:54:38.707139 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.707107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r" event={"ID":"8b784a43-78b7-4238-b297-5961496da2c9","Type":"ContainerStarted","Data":"e7a702083d26c8acf605af03565f40bef5dcdff74edbc854f24e7a6f8e4f5340"}
Jul 21 16:54:38.707420 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.707407    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:38.708273 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.708257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:38.819255 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.819219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:38.914490 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:38.914393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:39.713765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:39.713725    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r" event={"ID":"8b784a43-78b7-4238-b297-5961496da2c9","Type":"ContainerStarted","Data":"add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9"}
Jul 21 16:54:39.732042 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:39.731989    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r" podStartSLOduration=1.191456502 podStartE2EDuration="1.731972597s" totalImagesPullingTime="540.516095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:54:39.730586392 +0000 UTC m=+1601.998579056" watchObservedRunningTime="2026-07-21 16:54:39.731972597 +0000 UTC m=+1601.999965270"
Jul 21 16:54:40.718793 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:40.718762    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:41.876838 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:41.876806    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:54:46.733267 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:46.733231    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:54:49.773118 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:49.773087    2575 generic.go:356] "Generic (PLEG): container finished" podID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerID="e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6" exitCode=0
Jul 21 16:54:49.773589 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:49.773151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" event={"ID":"7b78e8af-37f3-41b1-8851-ddfb1d8f0077","Type":"ContainerDied","Data":"e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"}
Jul 21 16:54:49.773589 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:49.773528    2575 scope.go:117] "RemoveContainer" containerID="e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"
Jul 21 16:54:49.775567 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:49.775537    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:54:49.775654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:49.775601    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:54:49.775654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:49.775628    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:54:50.780087 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:50.780047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" event={"ID":"7b78e8af-37f3-41b1-8851-ddfb1d8f0077","Type":"ContainerStarted","Data":"f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928"}
Jul 21 16:54:51.734148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:51.734106    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:51.735431 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:51.735398    2575 patch_prober.go:28] interesting pod/e2e-ait-6a668444-openshift-default-77cf68f-wfftc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 21 16:54:51.735650 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:51.735621    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 21 16:54:52.734584 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:52.734542    2575 patch_prober.go:28] interesting pod/e2e-ait-6a668444-openshift-default-77cf68f-wfftc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 21 16:54:52.735251 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:52.735214    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 21 16:54:53.707971 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:53.707927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:53.733765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:53.733723    2575 patch_prober.go:28] interesting pod/e2e-ait-6a668444-openshift-default-77cf68f-wfftc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 21 16:54:53.733960 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:53.733787    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 21 16:54:54.737037 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:54.737006    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:54:54.738004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:54:54.737989    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:55:14.445998 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.445962    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"]
Jul 21 16:55:14.446554 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.446230    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r" podUID="8b784a43-78b7-4238-b297-5961496da2c9" containerName="maas-api" containerID="cri-o://add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9" gracePeriod=30
Jul 21 16:55:14.490895 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.490848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:14.702664 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.702608    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:55:14.782234 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.782200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b784a43-78b7-4238-b297-5961496da2c9-maas-api-tls\") pod \"8b784a43-78b7-4238-b297-5961496da2c9\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") "
Jul 21 16:55:14.782397 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.782238    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b784a43-78b7-4238-b297-5961496da2c9-openshift-service-ca\") pod \"8b784a43-78b7-4238-b297-5961496da2c9\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") "
Jul 21 16:55:14.782397 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.782297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfvdn\" (UniqueName: \"kubernetes.io/projected/8b784a43-78b7-4238-b297-5961496da2c9-kube-api-access-zfvdn\") pod \"8b784a43-78b7-4238-b297-5961496da2c9\" (UID: \"8b784a43-78b7-4238-b297-5961496da2c9\") "
Jul 21 16:55:14.782667 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.782643    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b784a43-78b7-4238-b297-5961496da2c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b784a43-78b7-4238-b297-5961496da2c9" (UID: "8b784a43-78b7-4238-b297-5961496da2c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:55:14.784584 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.784565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b784a43-78b7-4238-b297-5961496da2c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b784a43-78b7-4238-b297-5961496da2c9" (UID: "8b784a43-78b7-4238-b297-5961496da2c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:55:14.784691 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.784624    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b784a43-78b7-4238-b297-5961496da2c9-kube-api-access-zfvdn" (OuterVolumeSpecName: "kube-api-access-zfvdn") pod "8b784a43-78b7-4238-b297-5961496da2c9" (UID: "8b784a43-78b7-4238-b297-5961496da2c9"). InnerVolumeSpecName "kube-api-access-zfvdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:55:14.883943 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.883910    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfvdn\" (UniqueName: \"kubernetes.io/projected/8b784a43-78b7-4238-b297-5961496da2c9-kube-api-access-zfvdn\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:14.883943 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.883936    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b784a43-78b7-4238-b297-5961496da2c9-maas-api-tls\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:14.884101 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.883950    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b784a43-78b7-4238-b297-5961496da2c9-openshift-service-ca\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:14.893536 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.893504    2575 generic.go:356] "Generic (PLEG): container finished" podID="8b784a43-78b7-4238-b297-5961496da2c9" containerID="add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9" exitCode=0
Jul 21 16:55:14.893637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.893554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r" event={"ID":"8b784a43-78b7-4238-b297-5961496da2c9","Type":"ContainerDied","Data":"add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9"}
Jul 21 16:55:14.893637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.893591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r" event={"ID":"8b784a43-78b7-4238-b297-5961496da2c9","Type":"ContainerDied","Data":"e7a702083d26c8acf605af03565f40bef5dcdff74edbc854f24e7a6f8e4f5340"}
Jul 21 16:55:14.893637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.893618    2575 scope.go:117] "RemoveContainer" containerID="add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9"
Jul 21 16:55:14.893637 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.893555    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"
Jul 21 16:55:14.902558 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.902542    2575 scope.go:117] "RemoveContainer" containerID="add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9"
Jul 21 16:55:14.902799 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:55:14.902782    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9\": container with ID starting with add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9 not found: ID does not exist" containerID="add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9"
Jul 21 16:55:14.902845 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.902806    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9"} err="failed to get container status \"add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9\": rpc error: code = NotFound desc = could not find container \"add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9\": container with ID starting with add5f491c80fa431e8fccc0aec01aecf543a9cce33f52c24694349e0e6dba4c9 not found: ID does not exist"
Jul 21 16:55:14.913749 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.913729    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"]
Jul 21 16:55:14.917480 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:14.917460    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a668444-7cdccd5c66-dtp9r"]
Jul 21 16:55:16.245388 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:16.245352    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b784a43-78b7-4238-b297-5961496da2c9" path="/var/lib/kubelet/pods/8b784a43-78b7-4238-b297-5961496da2c9/volumes"
Jul 21 16:55:17.165625 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:17.165588    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:55:18.918787 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:18.918756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:19.031114 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.031077    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"]
Jul 21 16:55:19.031319 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.031290    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy" containerID="cri-o://f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928" gracePeriod=30
Jul 21 16:55:19.060380 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.060357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:19.294550 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.294518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:19.553902 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.553795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:19.648278 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.648249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:19.768330 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:19.768303    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:20.053135 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.053098    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"]
Jul 21 16:55:20.053689 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.053660    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b784a43-78b7-4238-b297-5961496da2c9" containerName="maas-api"
Jul 21 16:55:20.053689 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.053678    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b784a43-78b7-4238-b297-5961496da2c9" containerName="maas-api"
Jul 21 16:55:20.053811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.053785    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b784a43-78b7-4238-b297-5961496da2c9" containerName="maas-api"
Jul 21 16:55:20.056750 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.056729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.059929 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.059902    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-97b8dc80-gw-openshift-default-dockercfg-twwb8\""
Jul 21 16:55:20.071982 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.071958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"]
Jul 21 16:55:20.094071 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.094046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:20.205654 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.205627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:20.229599 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-data\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229723 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-credential-socket\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229723 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-envoy\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229723 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t468\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-kube-api-access-5t468\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-socket\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-token\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-podinfo\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.229847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istiod-ca-cert\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.230057 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.229939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-certs\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-data\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-credential-socket\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-envoy\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331322 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t468\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-kube-api-access-5t468\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-socket\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-token\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-podinfo\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istiod-ca-cert\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-certs\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331933 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-data\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.331933 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.331721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-credential-socket\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.332053 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.332023    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-certs\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.332260 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.332151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-socket\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.332382 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.332279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istiod-ca-cert\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.333733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.333712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-envoy\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.333977 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.333955    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-podinfo\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.339974 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.339954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-token\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.340263 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.340246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t468\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-kube-api-access-5t468\") pod \"e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") " pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.367231 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.367208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:20.508940 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.508861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"]
Jul 21 16:55:20.511581 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:55:20.511552    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3a5449_0d62_4fdf_8654_28cb09f81a95.slice/crio-8c7a7a41fb307c63992b35e4759c3e15a326f41248717d631371ef208d1931b0 WatchSource:0}: Error finding container 8c7a7a41fb307c63992b35e4759c3e15a326f41248717d631371ef208d1931b0: Status 404 returned error can't find the container with id 8c7a7a41fb307c63992b35e4759c3e15a326f41248717d631371ef208d1931b0
Jul 21 16:55:20.513730 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.513699    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:55:20.513814 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.513765    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:55:20.513814 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.513792    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:55:20.924137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.924102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" event={"ID":"3f3a5449-0d62-4fdf-8654-28cb09f81a95","Type":"ContainerStarted","Data":"a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"}
Jul 21 16:55:20.924321 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.924158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" event={"ID":"3f3a5449-0d62-4fdf-8654-28cb09f81a95","Type":"ContainerStarted","Data":"8c7a7a41fb307c63992b35e4759c3e15a326f41248717d631371ef208d1931b0"}
Jul 21 16:55:20.949747 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:20.949696    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podStartSLOduration=0.949683125 podStartE2EDuration="949.683125ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:55:20.946671207 +0000 UTC m=+1643.214663880" watchObservedRunningTime="2026-07-21 16:55:20.949683125 +0000 UTC m=+1643.217675797"
Jul 21 16:55:21.367536 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:21.367505    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:21.372326 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:21.372303    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:21.928653 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:21.928625    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:21.929471 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:21.929454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:22.510928 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:22.510894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:22.655432 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:22.655390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:22.908663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:22.908577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:23.179342 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:23.179254    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:23.279842 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:23.279812    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:24.276819 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.276798    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:55:24.371116 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-credential-socket\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371116 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-socket\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371122    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istiod-ca-cert\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371208    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-envoy\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371240    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-podinfo\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371266    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7546w\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-kube-api-access-7546w\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371305    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-certs\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371370 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371320    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:55:24.371663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371450    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-data\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371461    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:55:24.371663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371482    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-token\") pod \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\" (UID: \"7b78e8af-37f3-41b1-8851-ddfb1d8f0077\") "
Jul 21 16:55:24.371663 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371604    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:55:24.371869 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371684    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:55:24.371925 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371887    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.371925 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371914    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.372031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371931    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.372031 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.371944    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.372623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.372593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:55:24.373963 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.373942    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:55:24.374072 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.374007    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:55:24.374278 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.374255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:55:24.374482 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.374463    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-kube-api-access-7546w" (OuterVolumeSpecName: "kube-api-access-7546w") pod "7b78e8af-37f3-41b1-8851-ddfb1d8f0077" (UID: "7b78e8af-37f3-41b1-8851-ddfb1d8f0077"). InnerVolumeSpecName "kube-api-access-7546w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:55:24.472762 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.472735    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.472762 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.472759    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7546w\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-kube-api-access-7546w\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.472762 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.472769    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.472940 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.472777    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.472940 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.472785    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b78e8af-37f3-41b1-8851-ddfb1d8f0077-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:55:24.944179 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.944135    2575 generic.go:356] "Generic (PLEG): container finished" podID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerID="f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928" exitCode=0
Jul 21 16:55:24.944347 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.944206    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"
Jul 21 16:55:24.944347 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.944221    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" event={"ID":"7b78e8af-37f3-41b1-8851-ddfb1d8f0077","Type":"ContainerDied","Data":"f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928"}
Jul 21 16:55:24.944347 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.944284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc" event={"ID":"7b78e8af-37f3-41b1-8851-ddfb1d8f0077","Type":"ContainerDied","Data":"304d5a7fe2397cd2390082b86b7dfd0ad18f842467965a184fa0a8403f6b88ca"}
Jul 21 16:55:24.944347 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.944317    2575 scope.go:117] "RemoveContainer" containerID="f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928"
Jul 21 16:55:24.953572 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.953556    2575 scope.go:117] "RemoveContainer" containerID="e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"
Jul 21 16:55:24.961297 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.961254    2575 scope.go:117] "RemoveContainer" containerID="f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928"
Jul 21 16:55:24.961531 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:55:24.961511    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928\": container with ID starting with f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928 not found: ID does not exist" containerID="f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928"
Jul 21 16:55:24.961578 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.961540    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928"} err="failed to get container status \"f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928\": rpc error: code = NotFound desc = could not find container \"f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928\": container with ID starting with f2d10819571873b28ba7070dae8ad2b9365d002b774302856a058c3f8ef2d928 not found: ID does not exist"
Jul 21 16:55:24.961578 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.961558    2575 scope.go:117] "RemoveContainer" containerID="e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"
Jul 21 16:55:24.961773 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:55:24.961757    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6\": container with ID starting with e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6 not found: ID does not exist" containerID="e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"
Jul 21 16:55:24.961811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.961779    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6"} err="failed to get container status \"e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6\": rpc error: code = NotFound desc = could not find container \"e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6\": container with ID starting with e8b80ff9abf8bb9240d30f2cb7c64c7fa91f046d1d87584512e0d690856891a6 not found: ID does not exist"
Jul 21 16:55:24.969803 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.969781    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"]
Jul 21 16:55:24.974050 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:24.974029    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6a668444-openshift-default-77cf68f-wfftc"]
Jul 21 16:55:26.245135 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:26.245103    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" path="/var/lib/kubelet/pods/7b78e8af-37f3-41b1-8851-ddfb1d8f0077/volumes"
Jul 21 16:55:28.366196 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:28.366148    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:55:36.929953 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:36.929899    2575 patch_prober.go:28] interesting pod/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 16:55:36.930461 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:36.929977    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 16:55:37.000979 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:37.000952    2575 generic.go:356] "Generic (PLEG): container finished" podID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerID="a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa" exitCode=0
Jul 21 16:55:37.001133 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:37.000987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" event={"ID":"3f3a5449-0d62-4fdf-8654-28cb09f81a95","Type":"ContainerDied","Data":"a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"}
Jul 21 16:55:37.001447 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:37.001428    2575 scope.go:117] "RemoveContainer" containerID="a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"
Jul 21 16:55:37.002411 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:37.002384    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:55:37.002469 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:37.002457    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:55:37.002509 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:37.002489    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:55:38.007704 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:38.007664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" event={"ID":"3f3a5449-0d62-4fdf-8654-28cb09f81a95","Type":"ContainerStarted","Data":"934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf"}
Jul 21 16:55:38.367794 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:38.367708    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:38.367938 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:38.367912    2575 patch_prober.go:28] interesting pod/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 16:55:38.367993 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:38.367973    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 16:55:39.367719 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:39.367680    2575 patch_prober.go:28] interesting pod/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 16:55:39.368203 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:39.367757    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 16:55:40.367586 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:40.367549    2575 patch_prober.go:28] interesting pod/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 16:55:40.367765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:40.367615    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 16:55:41.368542 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:41.368509    2575 patch_prober.go:28] interesting pod/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 16:55:41.368922 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:41.368591    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 16:55:42.372369 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:42.372344    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:42.372748 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:42.372668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:42.373405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:42.373381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:55:57.863194 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:55:57.863138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:00.963145 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:00.963114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:56:02.569025 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:02.568992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:02.714982 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:02.714951    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"]
Jul 21 16:56:02.715234 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:02.715212    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy" containerID="cri-o://934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf" gracePeriod=30
Jul 21 16:56:02.733933 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:02.733907    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:02.973771 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:02.973691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:03.263185 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.263128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:03.551398 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.551322    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"]
Jul 21 16:56:03.551765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.551748    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy"
Jul 21 16:56:03.551852 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.551768    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy"
Jul 21 16:56:03.551909 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.551892    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy"
Jul 21 16:56:03.554668 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.554647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.557334 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.557310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-26d0f365-openshift-default-dockercfg-ln7qf\""
Jul 21 16:56:03.567641 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.567620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"]
Jul 21 16:56:03.580638 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.580613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:03.598105 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-envoy\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-token\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-credential-socket\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598227 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598213    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-socket\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598365 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53781dd4-77a9-4e4b-b151-c956802dd16c-istiod-ca-cert\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598365 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-kube-api-access-pxn9t\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598433 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-data\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598488 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-certs\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.598521 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.598504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-podinfo\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699146 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-certs\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699146 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-podinfo\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-envoy\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-token\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-credential-socket\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-socket\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53781dd4-77a9-4e4b-b151-c956802dd16c-istiod-ca-cert\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-kube-api-access-pxn9t\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699502 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-data\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699863 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-certs\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699863 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-socket\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.699863 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-credential-socket\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.700021 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.699981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-data\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.700123 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.700105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53781dd4-77a9-4e4b-b151-c956802dd16c-istiod-ca-cert\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.701812 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.701794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-envoy\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.701903 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.701871    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-podinfo\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.707445 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.707426    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-token\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.707538 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.707469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-kube-api-access-pxn9t\") pod \"e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") " pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:03.867330 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:03.867248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:04.007183 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.007137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"]
Jul 21 16:56:04.010192 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:56:04.010151    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53781dd4_77a9_4e4b_b151_c956802dd16c.slice/crio-7bbb2817ad9d6df3ae86542ad354140773b0bc73b5797232e0f4e3b31d75f6f5 WatchSource:0}: Error finding container 7bbb2817ad9d6df3ae86542ad354140773b0bc73b5797232e0f4e3b31d75f6f5: Status 404 returned error can't find the container with id 7bbb2817ad9d6df3ae86542ad354140773b0bc73b5797232e0f4e3b31d75f6f5
Jul 21 16:56:04.012351 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.012312    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:04.012431 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.012388    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:04.012431 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.012422    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:04.135143 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.135042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" event={"ID":"53781dd4-77a9-4e4b-b151-c956802dd16c","Type":"ContainerStarted","Data":"76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"}
Jul 21 16:56:04.135143 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.135107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" event={"ID":"53781dd4-77a9-4e4b-b151-c956802dd16c","Type":"ContainerStarted","Data":"7bbb2817ad9d6df3ae86542ad354140773b0bc73b5797232e0f4e3b31d75f6f5"}
Jul 21 16:56:04.138712 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.138686    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:04.154775 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.154722    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podStartSLOduration=1.1547033469999999 podStartE2EDuration="1.154703347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:04.154529315 +0000 UTC m=+1686.422522014" watchObservedRunningTime="2026-07-21 16:56:04.154703347 +0000 UTC m=+1686.422696024"
Jul 21 16:56:04.868052 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:04.868009    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:05.623710 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:05.623681    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.726886 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:05.726853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.801037 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:05.801001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:05.873246 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:05.873218    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:06.145321 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:06.145291    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:06.146283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:06.146264    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:06.259197 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:06.259139    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:06.360331 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:06.360291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:06.426593 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:06.426506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:07.975238 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:07.975154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:56:08.039074 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039044    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-envoy\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039102    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t468\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-kube-api-access-5t468\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039132    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-socket\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-certs\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039246    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-data\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039271    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-credential-socket\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039295    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-podinfo\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039642 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039327    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-token\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039642 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039352    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istiod-ca-cert\") pod \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\" (UID: \"3f3a5449-0d62-4fdf-8654-28cb09f81a95\") "
Jul 21 16:56:08.039642 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039429    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:08.039642 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039514    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:08.039833 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039745    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.039833 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039763    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.039833 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.039775    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:08.040039 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.040016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:08.040196 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.040149    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:08.041470 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.041442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:08.041656 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.041637    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:56:08.041997 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.041978    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:08.041997 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.041990    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-kube-api-access-5t468" (OuterVolumeSpecName: "kube-api-access-5t468") pod "3f3a5449-0d62-4fdf-8654-28cb09f81a95" (UID: "3f3a5449-0d62-4fdf-8654-28cb09f81a95"). InnerVolumeSpecName "kube-api-access-5t468". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:08.141226 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141198    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.141226 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141225    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t468\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-kube-api-access-5t468\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.141410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141236    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.141410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141245    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3a5449-0d62-4fdf-8654-28cb09f81a95-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.141410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141253    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.141410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141261    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.141410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.141269    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3a5449-0d62-4fdf-8654-28cb09f81a95-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:08.156882 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.156849    2575 generic.go:356] "Generic (PLEG): container finished" podID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerID="934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf" exitCode=0
Jul 21 16:56:08.157019 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.156908    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"
Jul 21 16:56:08.157019 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.156939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" event={"ID":"3f3a5449-0d62-4fdf-8654-28cb09f81a95","Type":"ContainerDied","Data":"934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf"}
Jul 21 16:56:08.157019 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.157009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k" event={"ID":"3f3a5449-0d62-4fdf-8654-28cb09f81a95","Type":"ContainerDied","Data":"8c7a7a41fb307c63992b35e4759c3e15a326f41248717d631371ef208d1931b0"}
Jul 21 16:56:08.157207 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.157039    2575 scope.go:117] "RemoveContainer" containerID="934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf"
Jul 21 16:56:08.166378 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.166360    2575 scope.go:117] "RemoveContainer" containerID="a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"
Jul 21 16:56:08.174224 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.174209    2575 scope.go:117] "RemoveContainer" containerID="934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf"
Jul 21 16:56:08.174452 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:56:08.174434    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf\": container with ID starting with 934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf not found: ID does not exist" containerID="934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf"
Jul 21 16:56:08.174501 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.174461    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf"} err="failed to get container status \"934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf\": rpc error: code = NotFound desc = could not find container \"934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf\": container with ID starting with 934275f2d4a6629625ce8859c50d19fef41ebe77c9081950e9115cf56c3cc6cf not found: ID does not exist"
Jul 21 16:56:08.174501 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.174478    2575 scope.go:117] "RemoveContainer" containerID="a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"
Jul 21 16:56:08.174690 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:56:08.174674    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa\": container with ID starting with a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa not found: ID does not exist" containerID="a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"
Jul 21 16:56:08.174731 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.174697    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa"} err="failed to get container status \"a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa\": rpc error: code = NotFound desc = could not find container \"a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa\": container with ID starting with a88873f446a8e74155cb0fd6dd2c818a1550b4b908c27d3b1bcfe27b39e4f6fa not found: ID does not exist"
Jul 21 16:56:08.179480 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.179456    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"]
Jul 21 16:56:08.183248 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.183226    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-97b8dc80-gw-openshift-default-555f84f459-ktt6k"]
Jul 21 16:56:08.247789 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:08.247766    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" path="/var/lib/kubelet/pods/3f3a5449-0d62-4fdf-8654-28cb09f81a95/volumes"
Jul 21 16:56:12.254877 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:12.254844    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:56:21.146988 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.146953    2575 patch_prober.go:28] interesting pod/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:56:21.147408 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.147012    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 21 16:56:21.219710 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.219677    2575 generic.go:356] "Generic (PLEG): container finished" podID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerID="76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883" exitCode=0
Jul 21 16:56:21.219859 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.219733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" event={"ID":"53781dd4-77a9-4e4b-b151-c956802dd16c","Type":"ContainerDied","Data":"76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"}
Jul 21 16:56:21.220072 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.220058    2575 scope.go:117] "RemoveContainer" containerID="76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"
Jul 21 16:56:21.221011 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.220982    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:21.221068 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.221055    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:21.221114 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:21.221087    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:22.227539 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:22.227505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" event={"ID":"53781dd4-77a9-4e4b-b151-c956802dd16c","Type":"ContainerStarted","Data":"0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90"}
Jul 21 16:56:22.868350 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:22.868310    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:22.868534 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:22.868514    2575 patch_prober.go:28] interesting pod/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:56:22.868578 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:22.868561    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 21 16:56:23.867855 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:23.867813    2575 patch_prober.go:28] interesting pod/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:56:23.868285 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:23.867871    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 21 16:56:24.868515 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:24.868479    2575 patch_prober.go:28] interesting pod/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:56:24.868918 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:24.868537    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 21 16:56:25.868144 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:25.868107    2575 patch_prober.go:28] interesting pod/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:56:25.868324 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:25.868197    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 21 16:56:26.871792 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:26.871762    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:26.872184 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:26.872104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:26.872827 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:26.872809    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:41.780937 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:41.780897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:44.462835 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:44.462793    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:56:46.403525 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:46.403481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:47.578357 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:47.578322    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"]
Jul 21 16:56:47.578847 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:47.578586    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy" containerID="cri-o://0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90" gracePeriod=30
Jul 21 16:56:47.598555 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:47.598527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:47.831552 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:47.831442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.080098 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.080064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.357410 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357382    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"]
Jul 21 16:56:48.357765 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357753    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy"
Jul 21 16:56:48.357811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357767    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy"
Jul 21 16:56:48.357811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357778    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy"
Jul 21 16:56:48.357811 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357783    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy"
Jul 21 16:56:48.358272 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357863    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy"
Jul 21 16:56:48.358272 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.357874    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b78e8af-37f3-41b1-8851-ddfb1d8f0077" containerName="istio-proxy"
Jul 21 16:56:48.361116 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.361096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.363686 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.363663    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ed714b0f-openshift-default-dockercfg-5n6vj\""
Jul 21 16:56:48.376450 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.376430    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"]
Jul 21 16:56:48.385611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.385591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.401510 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-envoy\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401627 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34686b39-c8cd-42c2-9a7f-65be99f41174-istiod-ca-cert\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401627 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-socket\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401627 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-certs\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401627 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-podinfo\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401627 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-credential-socket\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401828 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-token\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401828 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkvhr\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-kube-api-access-zkvhr\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.401828 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.401780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-data\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.502617 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-certs\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.502802 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-podinfo\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.502802 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-credential-socket\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.502802 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-token\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.502802 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkvhr\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-kube-api-access-zkvhr\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-data\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-envoy\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34686b39-c8cd-42c2-9a7f-65be99f41174-istiod-ca-cert\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.502921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-socket\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503016 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.503012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-certs\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.503391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-credential-socket\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503566 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.503421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-socket\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503732 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.503627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-data\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.503732 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.503676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34686b39-c8cd-42c2-9a7f-65be99f41174-istiod-ca-cert\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.505669 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.505642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-envoy\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.505795 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.505779    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-podinfo\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.511745 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.511724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkvhr\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-kube-api-access-zkvhr\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.511843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.511782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-token\") pod \"e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") " pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.671588 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.671494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:48.775790 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.775759    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:48.825993 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.825961    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"]
Jul 21 16:56:48.829302 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:56:48.829258    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34686b39_c8cd_42c2_9a7f_65be99f41174.slice/crio-ea9740329b0f49327d7434252dd286e5f55851c02b6b649bf116d73ae0272dd9 WatchSource:0}: Error finding container ea9740329b0f49327d7434252dd286e5f55851c02b6b649bf116d73ae0272dd9: Status 404 returned error can't find the container with id ea9740329b0f49327d7434252dd286e5f55851c02b6b649bf116d73ae0272dd9
Jul 21 16:56:48.831560 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.831528    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:48.831655 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.831598    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:48.831655 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:48.831624    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:56:49.361499 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:49.361467    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" event={"ID":"34686b39-c8cd-42c2-9a7f-65be99f41174","Type":"ContainerStarted","Data":"963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"}
Jul 21 16:56:49.361686 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:49.361515    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" event={"ID":"34686b39-c8cd-42c2-9a7f-65be99f41174","Type":"ContainerStarted","Data":"ea9740329b0f49327d7434252dd286e5f55851c02b6b649bf116d73ae0272dd9"}
Jul 21 16:56:49.396483 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:49.396438    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" podStartSLOduration=1.396422844 podStartE2EDuration="1.396422844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:49.391021465 +0000 UTC m=+1731.659014138" watchObservedRunningTime="2026-07-21 16:56:49.396422844 +0000 UTC m=+1731.664415515"
Jul 21 16:56:49.672423 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:49.672331    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:49.676917 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:49.676894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:50.366745 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:50.366718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:50.367780 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:50.367758    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:56:50.803912 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:50.803884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:50.906277 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:50.906248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.075583 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:51.075497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.374435 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:51.374350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.665347 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:51.665264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.766547 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:51.766512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:52.634228 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.634197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:52.737458 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.737428    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:52.829857 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.829831    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:52.945736 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945643    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-token\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.945736 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-kube-api-access-pxn9t\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.945736 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945697    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-podinfo\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946048 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945744    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-data\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946048 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945767    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-envoy\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946048 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945791    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-socket\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946048 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-certs\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946048 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945860    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53781dd4-77a9-4e4b-b151-c956802dd16c-istiod-ca-cert\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946048 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.945901    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-credential-socket\") pod \"53781dd4-77a9-4e4b-b151-c956802dd16c\" (UID: \"53781dd4-77a9-4e4b-b151-c956802dd16c\") "
Jul 21 16:56:52.946372 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.946156    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:52.946372 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.946205    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:52.946468 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.946401    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:52.946624 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.946593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-data" (OuterVolumeSpecName: "istio-data") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:52.946869 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.946646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53781dd4-77a9-4e4b-b151-c956802dd16c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:52.948139 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.948118    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-token" (OuterVolumeSpecName: "istio-token") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:52.948267 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.948217    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-kube-api-access-pxn9t" (OuterVolumeSpecName: "kube-api-access-pxn9t") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "kube-api-access-pxn9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:52.948578 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.948550    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:56:52.948698 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:52.948630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53781dd4-77a9-4e4b-b151-c956802dd16c" (UID: "53781dd4-77a9-4e4b-b151-c956802dd16c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:56:53.047690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047652    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047683    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/53781dd4-77a9-4e4b-b151-c956802dd16c-kube-api-access-pxn9t\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047692    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047690 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047701    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047710    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047719    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047730    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047738    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53781dd4-77a9-4e4b-b151-c956802dd16c-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.047964 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.047745    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53781dd4-77a9-4e4b-b151-c956802dd16c-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:56:53.382973 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.382940    2575 generic.go:356] "Generic (PLEG): container finished" podID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerID="0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90" exitCode=0
Jul 21 16:56:53.383201 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.382979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" event={"ID":"53781dd4-77a9-4e4b-b151-c956802dd16c","Type":"ContainerDied","Data":"0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90"}
Jul 21 16:56:53.383201 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.383011    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"
Jul 21 16:56:53.383201 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.383040    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd" event={"ID":"53781dd4-77a9-4e4b-b151-c956802dd16c","Type":"ContainerDied","Data":"7bbb2817ad9d6df3ae86542ad354140773b0bc73b5797232e0f4e3b31d75f6f5"}
Jul 21 16:56:53.383201 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.383064    2575 scope.go:117] "RemoveContainer" containerID="0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90"
Jul 21 16:56:53.393112 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.393095    2575 scope.go:117] "RemoveContainer" containerID="76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"
Jul 21 16:56:53.401137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.401119    2575 scope.go:117] "RemoveContainer" containerID="0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90"
Jul 21 16:56:53.401428 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:56:53.401405    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90\": container with ID starting with 0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90 not found: ID does not exist" containerID="0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90"
Jul 21 16:56:53.401513 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.401440    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90"} err="failed to get container status \"0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90\": rpc error: code = NotFound desc = could not find container \"0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90\": container with ID starting with 0efcafe489ca7d5286e9cdfbe252e88d702e68a23ee506c7474ea37880befb90 not found: ID does not exist"
Jul 21 16:56:53.401513 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.401463    2575 scope.go:117] "RemoveContainer" containerID="76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"
Jul 21 16:56:53.401695 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:56:53.401677    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883\": container with ID starting with 76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883 not found: ID does not exist" containerID="76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"
Jul 21 16:56:53.401732 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.401701    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883"} err="failed to get container status \"76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883\": rpc error: code = NotFound desc = could not find container \"76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883\": container with ID starting with 76e33c3a4d9501abcdeaf258eaf1fb14c3a9962ab3e6bec265c5817e8333e883 not found: ID does not exist"
Jul 21 16:56:53.409403 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.409382    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"]
Jul 21 16:56:53.418318 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.415031    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-26d0f365-openshift-default-78b78886cf-d5ksd"]
Jul 21 16:56:53.523348 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.523313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:53.648030 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.647954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:53.685720 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:53.685687    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:56:54.245265 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:56:54.245234    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" path="/var/lib/kubelet/pods/53781dd4-77a9-4e4b-b151-c956802dd16c/volumes"
Jul 21 16:57:01.422683 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:01.422655    2575 generic.go:356] "Generic (PLEG): container finished" podID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerID="963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67" exitCode=0
Jul 21 16:57:01.423061 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:01.422723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" event={"ID":"34686b39-c8cd-42c2-9a7f-65be99f41174","Type":"ContainerDied","Data":"963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"}
Jul 21 16:57:01.423111 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:01.423095    2575 scope.go:117] "RemoveContainer" containerID="963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"
Jul 21 16:57:01.424147 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:01.424124    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:57:01.424238 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:01.424215    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:57:01.424286 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:01.424252    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:57:02.431854 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:02.431818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" event={"ID":"34686b39-c8cd-42c2-9a7f-65be99f41174","Type":"ContainerStarted","Data":"dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c"}
Jul 21 16:57:02.671798 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:02.671760    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:57:02.673225 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:02.673199    2575 patch_prober.go:28] interesting pod/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 21 16:57:02.673345 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:02.673252    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 21 16:57:03.672250 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:03.672213    2575 patch_prober.go:28] interesting pod/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 21 16:57:03.672692 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:03.672267    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 21 16:57:04.672247 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:04.672210    2575 patch_prober.go:28] interesting pod/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 21 16:57:04.672427 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:04.672269    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 21 16:57:05.367088 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:05.367053    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:57:05.672257 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:05.672146    2575 patch_prober.go:28] interesting pod/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 21 16:57:05.672257 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:05.672228    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 21 16:57:06.676244 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:06.676205    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:57:06.677241 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:06.677222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:57:26.500051 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:26.500019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:29.469705 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:29.469672    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:57:30.847283 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:30.847246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:30.991579 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:30.991547    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"]
Jul 21 16:57:30.991781 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:30.991758    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy" containerID="cri-o://dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c" gracePeriod=30
Jul 21 16:57:31.017346 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:31.017318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:31.264079 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:31.264019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:31.751074 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:31.751039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:31.843512 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:31.843478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:31.943836 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:31.943806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:33.480184 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:33.480143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:36.239961 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.239939    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:57:36.317685 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-token\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.317837 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317676    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkvhr\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-kube-api-access-zkvhr\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.317837 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-certs\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.317837 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317807    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-envoy\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.317837 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317829    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34686b39-c8cd-42c2-9a7f-65be99f41174-istiod-ca-cert\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.318069 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-credential-socket\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.318069 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.317942    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-podinfo\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.318069 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318033    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:36.318262 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-socket\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.318262 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318146    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-data\") pod \"34686b39-c8cd-42c2-9a7f-65be99f41174\" (UID: \"34686b39-c8cd-42c2-9a7f-65be99f41174\") "
Jul 21 16:57:36.318378 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318317    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:36.318378 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318360    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:36.318646 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318569    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.318646 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318596    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.318646 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318612    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.318646 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.318478    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34686b39-c8cd-42c2-9a7f-65be99f41174-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:57:36.319137 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.319116    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-data" (OuterVolumeSpecName: "istio-data") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:36.320676 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.320654    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:57:36.320676 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.320665    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-kube-api-access-zkvhr" (OuterVolumeSpecName: "kube-api-access-zkvhr") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "kube-api-access-zkvhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:57:36.320850 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.320689    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-token" (OuterVolumeSpecName: "istio-token") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:57:36.320850 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.320817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34686b39-c8cd-42c2-9a7f-65be99f41174" (UID: "34686b39-c8cd-42c2-9a7f-65be99f41174"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:57:36.419405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.419372    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.419405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.419400    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.419405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.419411    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.419611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.419424    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkvhr\" (UniqueName: \"kubernetes.io/projected/34686b39-c8cd-42c2-9a7f-65be99f41174-kube-api-access-zkvhr\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.419611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.419435    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34686b39-c8cd-42c2-9a7f-65be99f41174-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.419611 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.419446    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34686b39-c8cd-42c2-9a7f-65be99f41174-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:57:36.596208 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.596118    2575 generic.go:356] "Generic (PLEG): container finished" podID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerID="dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c" exitCode=0
Jul 21 16:57:36.596208 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.596188    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"
Jul 21 16:57:36.596208 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.596196    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" event={"ID":"34686b39-c8cd-42c2-9a7f-65be99f41174","Type":"ContainerDied","Data":"dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c"}
Jul 21 16:57:36.596424 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.596253    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd" event={"ID":"34686b39-c8cd-42c2-9a7f-65be99f41174","Type":"ContainerDied","Data":"ea9740329b0f49327d7434252dd286e5f55851c02b6b649bf116d73ae0272dd9"}
Jul 21 16:57:36.596424 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.596274    2575 scope.go:117] "RemoveContainer" containerID="dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c"
Jul 21 16:57:36.605202 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.605157    2575 scope.go:117] "RemoveContainer" containerID="963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"
Jul 21 16:57:36.613102 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.613087    2575 scope.go:117] "RemoveContainer" containerID="dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c"
Jul 21 16:57:36.613361 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:57:36.613344    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c\": container with ID starting with dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c not found: ID does not exist" containerID="dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c"
Jul 21 16:57:36.613429 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.613370    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c"} err="failed to get container status \"dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c\": rpc error: code = NotFound desc = could not find container \"dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c\": container with ID starting with dd0880159913259c83bee4253141c59d3968a1e6645ea84e499a88bb8cdd653c not found: ID does not exist"
Jul 21 16:57:36.613429 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.613385    2575 scope.go:117] "RemoveContainer" containerID="963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"
Jul 21 16:57:36.613612 ip-10-0-129-98 kubenswrapper[2575]: E0721 16:57:36.613597    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67\": container with ID starting with 963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67 not found: ID does not exist" containerID="963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"
Jul 21 16:57:36.613651 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.613618    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67"} err="failed to get container status \"963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67\": rpc error: code = NotFound desc = could not find container \"963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67\": container with ID starting with 963fd9b272a0b0aab03b0c23171160e8ac09382c559ee548721810992314af67 not found: ID does not exist"
Jul 21 16:57:36.620030 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.620009    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"]
Jul 21 16:57:36.624312 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:36.624292    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ed714b0f-openshift-default-5876844cbc-c8hkd"]
Jul 21 16:57:38.246981 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:38.246949    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" path="/var/lib/kubelet/pods/34686b39-c8cd-42c2-9a7f-65be99f41174/volumes"
Jul 21 16:57:42.399735 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:42.399709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:42.587292 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:42.587261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:42.772803 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:42.772767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:42.952700 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:42.952649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:43.505808 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:43.505778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:58.300065 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:58.300037    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:57:58.303827 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:57:58.303799    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 16:58:09.443706 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:09.443676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.590119 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:16.590086    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.660620 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:16.660589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.763837 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:16.763806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:16.856979 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:16.856901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:32.763585 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:32.763551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:38.792929 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:38.792891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:38.899357 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:38.899322    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:38.992236 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:38.992189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:49.542471 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:49.542440    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:50.360222 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:50.360191    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:56.716559 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:56.716529    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:56.825751 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:56.825708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:56.920904 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:56.920872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:57.021682 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:58:57.021593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:00.458932 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:00.458899    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:59:02.876508 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:02.876465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:02.976742 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:02.976693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:03.077261 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:03.077231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:04.787689 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:04.787657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:10.468870 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:10.468836    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:59:10.639009 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:10.638982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:10.742449 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:10.742356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:11.337638 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:11.337606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:17.887520 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:17.887488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:17.991359 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:17.991328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:18.126697 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.126663    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:18.424085 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424048    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"]
Jul 21 16:59:18.424527 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424508    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy"
Jul 21 16:59:18.424623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424529    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy"
Jul 21 16:59:18.424623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424545    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy"
Jul 21 16:59:18.424623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424555    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy"
Jul 21 16:59:18.424623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424571    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy"
Jul 21 16:59:18.424623 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424579    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy"
Jul 21 16:59:18.424874 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424683    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy"
Jul 21 16:59:18.424874 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424699    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy"
Jul 21 16:59:18.424874 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424709    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3a5449-0d62-4fdf-8654-28cb09f81a95" containerName="istio-proxy"
Jul 21 16:59:18.424874 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.424718    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy"
Jul 21 16:59:18.429184 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.429139    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.433461 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.433431    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 16:59:18.433742 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.433718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-13ffe089-openshift-default-dockercfg-rfr8f\""
Jul 21 16:59:18.448863 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.448833    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"]
Jul 21 16:59:18.454148 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.454120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:18.484707 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-socket\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.484911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-certs\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.484911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-envoy\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.484911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-podinfo\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.484911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wks\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-kube-api-access-67wks\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.484911 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istiod-ca-cert\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.485155 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-token\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.485155 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.484955    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-credential-socket\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.485155 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.485054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-data\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.547096 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.547062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:18.585499 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-certs\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585499 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-envoy\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-podinfo\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wks\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-kube-api-access-67wks\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istiod-ca-cert\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-token\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-credential-socket\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-data\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.585733 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-socket\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.586136 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.585981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-certs\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.586223 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.586138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-socket\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.586282 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.586231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-credential-socket\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.586282 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.586239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-data\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.586378 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.586362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istiod-ca-cert\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.588446 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.588427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-envoy\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.588758 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.588737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-podinfo\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.593944 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.593913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-token\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.594059 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.594040    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wks\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-kube-api-access-67wks\") pod \"e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") " pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.743597 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.743497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:18.907379 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.907350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"]
Jul 21 16:59:18.909757 ip-10-0-129-98 kubenswrapper[2575]: W0721 16:59:18.909707    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edbbf02_7458_4ec9_88d2_d19ac351d82f.slice/crio-4217a7971d46dd7d6ff1760b3b8db8f0972af0f66d721a7420c71904f90c696f WatchSource:0}: Error finding container 4217a7971d46dd7d6ff1760b3b8db8f0972af0f66d721a7420c71904f90c696f: Status 404 returned error can't find the container with id 4217a7971d46dd7d6ff1760b3b8db8f0972af0f66d721a7420c71904f90c696f
Jul 21 16:59:18.911843 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.911812    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:59:18.911937 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.911890    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:59:18.912004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:18.911938    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:59:19.057820 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:19.057780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" event={"ID":"0edbbf02-7458-4ec9-88d2-d19ac351d82f","Type":"ContainerStarted","Data":"560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"}
Jul 21 16:59:19.058018 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:19.057847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" event={"ID":"0edbbf02-7458-4ec9-88d2-d19ac351d82f","Type":"ContainerStarted","Data":"4217a7971d46dd7d6ff1760b3b8db8f0972af0f66d721a7420c71904f90c696f"}
Jul 21 16:59:19.078666 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:19.078610    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podStartSLOduration=1.078591897 podStartE2EDuration="1.078591897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:59:19.076481402 +0000 UTC m=+1881.344474077" watchObservedRunningTime="2026-07-21 16:59:19.078591897 +0000 UTC m=+1881.346584571"
Jul 21 16:59:19.744567 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:19.744529    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:19.749504 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:19.749477    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:20.062665 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:20.062583    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:20.063697 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:20.063680    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:21.260112 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:21.260045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.359106 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:21.359068    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.437634 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:21.437605    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.616652 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:21.616557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:59:21.738056 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:21.738028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.947541 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:21.947451    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:22.050243 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:22.050205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:25.690846 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:25.690814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:26.374969 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:26.374932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:26.474941 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:26.474873    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:26.807314 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:26.807282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:30.369131 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:30.369097    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:59:32.565280 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:32.565238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:32.641524 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:32.641486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:35.064405 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.064375    2575 patch_prober.go:28] interesting pod/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 16:59:35.064827 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.064437    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 16:59:35.132152 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.132121    2575 generic.go:356] "Generic (PLEG): container finished" podID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerID="560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d" exitCode=0
Jul 21 16:59:35.132330 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.132197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" event={"ID":"0edbbf02-7458-4ec9-88d2-d19ac351d82f","Type":"ContainerDied","Data":"560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"}
Jul 21 16:59:35.132551 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.132538    2575 scope.go:117] "RemoveContainer" containerID="560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"
Jul 21 16:59:35.133618 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.133593    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:59:35.133681 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.133657    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:59:35.133719 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:35.133690    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 16:59:36.154339 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:36.154304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" event={"ID":"0edbbf02-7458-4ec9-88d2-d19ac351d82f","Type":"ContainerStarted","Data":"8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f"}
Jul 21 16:59:36.744123 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:36.744070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:36.744581 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:36.744533    2575 patch_prober.go:28] interesting pod/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 16:59:36.744779 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:36.744753    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 16:59:37.744018 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:37.743980    2575 patch_prober.go:28] interesting pod/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 16:59:37.744629 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:37.744593    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 16:59:38.744982 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:38.744942    2575 patch_prober.go:28] interesting pod/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 16:59:38.745520 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:38.745013    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 16:59:39.744996 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:39.744955    2575 patch_prober.go:28] interesting pod/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 16:59:39.746004 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:39.745598    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 16:59:40.748463 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:40.748434    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:40.748834 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:40.748679    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:40.749520 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:40.749500    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:43.517042 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:43.517004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:46.370028 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:46.369997    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 16:59:48.015767 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:48.015734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:48.421428 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:48.421341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.143099 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.143068    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.210698 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.210662    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.383954 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.383891    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"]
Jul 21 16:59:54.388455 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.388413    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" containerID="cri-o://8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f" gracePeriod=30
Jul 21 16:59:54.416006 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.415934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.648790 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.648755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.780311 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.780282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.872779 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.872755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:54.998600 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:54.998579    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:55.750617 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:55.750571    2575 patch_prober.go:28] interesting pod/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 16:59:55.750978 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:55.750642    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:59:59.635738 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.635713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 16:59:59.750709 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750682    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-socket\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.750849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-podinfo\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.750849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-data\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.750849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750820    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-credential-socket\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.750849 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750844    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-token\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.751064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-envoy\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.751064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750902    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istiod-ca-cert\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.751064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750946    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67wks\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-kube-api-access-67wks\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.751064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:59:59.751064 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.750988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-certs\") pod \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\" (UID: \"0edbbf02-7458-4ec9-88d2-d19ac351d82f\") "
Jul 21 16:59:59.751340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.751054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:59:59.751340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.751293    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.751340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.751314    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.751340 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.751312    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:59:59.751531 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.751358    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:59:59.751860 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.751831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:59:59.753122 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.753094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:59:59.753240 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.753147    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:59:59.753291 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.753263    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-kube-api-access-67wks" (OuterVolumeSpecName: "kube-api-access-67wks") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "kube-api-access-67wks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:59:59.753449 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.753426    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0edbbf02-7458-4ec9-88d2-d19ac351d82f" (UID: "0edbbf02-7458-4ec9-88d2-d19ac351d82f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:59:59.852123 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852099    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.852123 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852121    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.852273 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852130    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.852273 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852139    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67wks\" (UniqueName: \"kubernetes.io/projected/0edbbf02-7458-4ec9-88d2-d19ac351d82f-kube-api-access-67wks\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.852273 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852148    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.852273 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852157    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 16:59:59.852273 ip-10-0-129-98 kubenswrapper[2575]: I0721 16:59:59.852186    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0edbbf02-7458-4ec9-88d2-d19ac351d82f-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:00:00.273376 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.273342    2575 generic.go:356] "Generic (PLEG): container finished" podID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerID="8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f" exitCode=0
Jul 21 17:00:00.273496 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.273385    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"
Jul 21 17:00:00.273496 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.273422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" event={"ID":"0edbbf02-7458-4ec9-88d2-d19ac351d82f","Type":"ContainerDied","Data":"8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f"}
Jul 21 17:00:00.273496 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.273474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr" event={"ID":"0edbbf02-7458-4ec9-88d2-d19ac351d82f","Type":"ContainerDied","Data":"4217a7971d46dd7d6ff1760b3b8db8f0972af0f66d721a7420c71904f90c696f"}
Jul 21 17:00:00.273614 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.273498    2575 scope.go:117] "RemoveContainer" containerID="8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f"
Jul 21 17:00:00.282110 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.282089    2575 scope.go:117] "RemoveContainer" containerID="560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"
Jul 21 17:00:00.290023 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.290004    2575 scope.go:117] "RemoveContainer" containerID="8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f"
Jul 21 17:00:00.290436 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:00:00.290382    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f\": container with ID starting with 8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f not found: ID does not exist" containerID="8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f"
Jul 21 17:00:00.290436 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.290417    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f"} err="failed to get container status \"8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f\": rpc error: code = NotFound desc = could not find container \"8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f\": container with ID starting with 8d15b0cbee45f9ed9576197ae4129d77f6336d30254d646029c0e1dd9681b83f not found: ID does not exist"
Jul 21 17:00:00.290436 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.290440    2575 scope.go:117] "RemoveContainer" containerID="560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"
Jul 21 17:00:00.290713 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:00:00.290695    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d\": container with ID starting with 560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d not found: ID does not exist" containerID="560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"
Jul 21 17:00:00.290766 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.290718    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d"} err="failed to get container status \"560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d\": rpc error: code = NotFound desc = could not find container \"560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d\": container with ID starting with 560f7cf602ed5123458bf603250005e4f3fc21bde748fc00d826b7cb9199bd4d not found: ID does not exist"
Jul 21 17:00:00.292343 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.292324    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"]
Jul 21 17:00:00.296211 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.296185    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-13ffe089-openshift-default-6584c569f-7m4rr"]
Jul 21 17:00:00.894062 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:00.894025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:01.042895 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:01.042856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:01.168428 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:01.168334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:01.287924 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:01.287897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:02.245790 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:02.245759    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" path="/var/lib/kubelet/pods/0edbbf02-7458-4ec9-88d2-d19ac351d82f/volumes"
Jul 21 17:00:07.306198 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:07.306135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:07.446392 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:07.446362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:14.205071 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.205037    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:14.336406 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336368    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"]
Jul 21 17:00:14.336768 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336752    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy"
Jul 21 17:00:14.336862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336772    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy"
Jul 21 17:00:14.336862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336787    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy"
Jul 21 17:00:14.336862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336792    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="34686b39-c8cd-42c2-9a7f-65be99f41174" containerName="istio-proxy"
Jul 21 17:00:14.336862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336801    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy"
Jul 21 17:00:14.336862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336808    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy"
Jul 21 17:00:14.337091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336868    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="53781dd4-77a9-4e4b-b151-c956802dd16c" containerName="istio-proxy"
Jul 21 17:00:14.337091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336876    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy"
Jul 21 17:00:14.337091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.336882    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy"
Jul 21 17:00:14.340235 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.340216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.342741 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.342711    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 17:00:14.342872 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.342803    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-299dfdef-openshift-default-dockercfg-4hpgm\""
Jul 21 17:00:14.352137 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.352111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"]
Jul 21 17:00:14.377500 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.377466    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:14.388731 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-socket\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.388895 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-podinfo\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.388895 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-credential-socket\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.388895 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-certs\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.388895 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7b8\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-kube-api-access-xj7b8\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.389091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-token\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.389091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388955    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-data\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.389091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.388980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istiod-ca-cert\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.389091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.389060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-envoy\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490453 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-data\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490453 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istiod-ca-cert\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-envoy\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-socket\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-podinfo\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-credential-socket\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-certs\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7b8\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-kube-api-access-xj7b8\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490985 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-token\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490985 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-data\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.490985 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.490953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-credential-socket\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.491141 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.491079    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-socket\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.491141 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.491094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-certs\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.491278 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.491245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istiod-ca-cert\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.492979 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.492944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-envoy\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.493540 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.493519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-podinfo\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.510831 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.510805    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-token\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.512285 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.512261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7b8\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-kube-api-access-xj7b8\") pod \"e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") " pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.652762 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.652709    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:14.735281 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.735253    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:14.796252 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.796227    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"]
Jul 21 17:00:14.798370 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:00:14.798344    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2e3130_8e94_42ab_bc74_457fa9bd1419.slice/crio-6d68bef6f60813739ace08b47ece194ba9ed2fad212b64a0f2392c59f348aef0 WatchSource:0}: Error finding container 6d68bef6f60813739ace08b47ece194ba9ed2fad212b64a0f2392c59f348aef0: Status 404 returned error can't find the container with id 6d68bef6f60813739ace08b47ece194ba9ed2fad212b64a0f2392c59f348aef0
Jul 21 17:00:14.800410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.800382    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:00:14.800473 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.800449    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:00:14.800510 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:14.800478    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:00:15.355208 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:15.355147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" event={"ID":"5b2e3130-8e94-42ab-bc74-457fa9bd1419","Type":"ContainerStarted","Data":"e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"}
Jul 21 17:00:15.355702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:15.355235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" event={"ID":"5b2e3130-8e94-42ab-bc74-457fa9bd1419","Type":"ContainerStarted","Data":"6d68bef6f60813739ace08b47ece194ba9ed2fad212b64a0f2392c59f348aef0"}
Jul 21 17:00:15.379429 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:15.379371    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" podStartSLOduration=1.379348716 podStartE2EDuration="1.379348716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:15.37706395 +0000 UTC m=+1937.645056616" watchObservedRunningTime="2026-07-21 17:00:15.379348716 +0000 UTC m=+1937.647341393"
Jul 21 17:00:15.653679 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:15.653581    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:15.659005 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:15.658979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:16.360347 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:16.360315    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:16.361226 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:16.361207    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:17.287456 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:17.287414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:18.944525 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:18.944492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:21.816572 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:21.816539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:22.559527 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:22.559485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:00:30.426160 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:30.426131    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerID="e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d" exitCode=0
Jul 21 17:00:30.426554 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:30.426208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" event={"ID":"5b2e3130-8e94-42ab-bc74-457fa9bd1419","Type":"ContainerDied","Data":"e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"}
Jul 21 17:00:30.426600 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:30.426571    2575 scope.go:117] "RemoveContainer" containerID="e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"
Jul 21 17:00:30.427608 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:30.427576    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:00:30.427716 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:30.427644    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:00:30.427716 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:30.427676    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:00:31.360480 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:31.360446    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:31.436684 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:31.436647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" event={"ID":"5b2e3130-8e94-42ab-bc74-457fa9bd1419","Type":"ContainerStarted","Data":"9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f"}
Jul 21 17:00:31.653426 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:31.653329    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:31.654623 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:31.654598    2575 patch_prober.go:28] interesting pod/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 21 17:00:31.654731 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:31.654661    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 21 17:00:32.653333 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:32.653297    2575 patch_prober.go:28] interesting pod/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 21 17:00:32.653706 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:32.653363    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 21 17:00:33.653919 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:33.653874    2575 patch_prober.go:28] interesting pod/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 21 17:00:33.654427 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:33.653958    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 21 17:00:34.653721 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:34.653683    2575 patch_prober.go:28] interesting pod/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 21 17:00:34.653913 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:34.653743    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 21 17:00:35.657379 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:35.657350    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:35.657748 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:35.657718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:35.658409 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:35.658389    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:00:42.709402 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:42.709372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:46.564551 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:46.564516    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:00:55.298760 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:00:55.298670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:01.787277 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:01.787235    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:01:19.883037 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:19.883003    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:01:21.180041 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:21.180005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:25.652458 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:25.652417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:27.878744 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:27.878715    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:29.575623 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:29.575592    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:01:33.018849 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:33.018820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:43.123326 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:43.123293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:54.737371 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:54.737327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:54.920925 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:01:54.920893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:09.506810 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:09.506774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:12.276904 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:12.276867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:19.843996 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:19.843917    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:24.453825 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:24.453787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:24.557199 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:24.557126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:26.982102 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:26.982066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:27.220185 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:27.220142    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:27.372674 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:27.372637    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"]
Jul 21 17:02:27.372895 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:27.372871    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy" containerID="cri-o://9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f" gracePeriod=30
Jul 21 17:02:27.427348 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:27.427314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:27.598853 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:27.598805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:28.764565 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:28.764512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:29.043035 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:29.042930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:29.940627 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:29.940564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:30.620021 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:30.619990    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:31.323314 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:31.323281    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:02:31.691390 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:31.691310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:32.620595 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.620570    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:02:32.686395 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686319    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-credential-socket\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686395 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686383    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj7b8\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-kube-api-access-xj7b8\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686416    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-envoy\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686460    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-podinfo\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686494    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-socket\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686517    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-certs\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686544    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-token\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686564    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istiod-ca-cert\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.686605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.686597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-data\") pod \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\" (UID: \"5b2e3130-8e94-42ab-bc74-457fa9bd1419\") "
Jul 21 17:02:32.687955 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.687423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:32.687955 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.687504    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:32.687955 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.687619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:32.687955 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.687746    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:32.687955 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.687926    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:02:32.690384 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.690356    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:02:32.690384 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.690362    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:32.690582 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.690394    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:32.690582 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.690562    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-kube-api-access-xj7b8" (OuterVolumeSpecName: "kube-api-access-xj7b8") pod "5b2e3130-8e94-42ab-bc74-457fa9bd1419" (UID: "5b2e3130-8e94-42ab-bc74-457fa9bd1419"). InnerVolumeSpecName "kube-api-access-xj7b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:32.788276 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788244    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788276 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788272    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788276 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788282    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj7b8\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-kube-api-access-xj7b8\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788291    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788300    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788308    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788315    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b2e3130-8e94-42ab-bc74-457fa9bd1419-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788323    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:32.788497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:32.788330    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b2e3130-8e94-42ab-bc74-457fa9bd1419-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:02:33.017738 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.017709    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerID="9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f" exitCode=0
Jul 21 17:02:33.017924 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.017776    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"
Jul 21 17:02:33.017924 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.017777    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" event={"ID":"5b2e3130-8e94-42ab-bc74-457fa9bd1419","Type":"ContainerDied","Data":"9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f"}
Jul 21 17:02:33.017924 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.017910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb" event={"ID":"5b2e3130-8e94-42ab-bc74-457fa9bd1419","Type":"ContainerDied","Data":"6d68bef6f60813739ace08b47ece194ba9ed2fad212b64a0f2392c59f348aef0"}
Jul 21 17:02:33.018029 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.017933    2575 scope.go:117] "RemoveContainer" containerID="9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f"
Jul 21 17:02:33.027096 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.027076    2575 scope.go:117] "RemoveContainer" containerID="e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"
Jul 21 17:02:33.034744 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.034718    2575 scope.go:117] "RemoveContainer" containerID="9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f"
Jul 21 17:02:33.034973 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:02:33.034956    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f\": container with ID starting with 9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f not found: ID does not exist" containerID="9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f"
Jul 21 17:02:33.035029 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.034982    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f"} err="failed to get container status \"9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f\": rpc error: code = NotFound desc = could not find container \"9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f\": container with ID starting with 9e6607dd3a706da02ece433bab6708b847c635f87c635d17b08b7f6505973f8f not found: ID does not exist"
Jul 21 17:02:33.035029 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.034998    2575 scope.go:117] "RemoveContainer" containerID="e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"
Jul 21 17:02:33.035223 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:02:33.035204    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d\": container with ID starting with e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d not found: ID does not exist" containerID="e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"
Jul 21 17:02:33.035288 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.035234    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d"} err="failed to get container status \"e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d\": rpc error: code = NotFound desc = could not find container \"e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d\": container with ID starting with e200ce9869398b19e70deb3830817f91189ae05c84f6a87e615fc0bb06f5cd5d not found: ID does not exist"
Jul 21 17:02:33.071314 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.071283    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"]
Jul 21 17:02:33.077107 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:33.077083    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-299dfdef-openshift-default-5b8d76689f-g87hb"]
Jul 21 17:02:34.245505 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:34.245474    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" path="/var/lib/kubelet/pods/5b2e3130-8e94-42ab-bc74-457fa9bd1419/volumes"
Jul 21 17:02:37.282766 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:37.282730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:37.839945 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:37.839913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:37.972776 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:37.972741    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.569501 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:38.569445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:44.919450 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:44.919414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:45.055778 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:45.055743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:45.157623 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:45.157591    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:02:45.179894 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:45.179816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:55.646712 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:55.646674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:56.017690 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:56.017641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:58.329648 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:58.329620    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:02:58.335498 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:02:58.335475    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:03:16.965078 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:16.965045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:23.285906 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.285860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:23.387479 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.387449    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:23.647817 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.647725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:23.954725 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.954644    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"]
Jul 21 17:03:23.954996 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.954983    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy"
Jul 21 17:03:23.955059 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.954998    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy"
Jul 21 17:03:23.955059 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.955010    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy"
Jul 21 17:03:23.955059 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.955015    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0edbbf02-7458-4ec9-88d2-d19ac351d82f" containerName="istio-proxy"
Jul 21 17:03:23.955249 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.955080    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy"
Jul 21 17:03:23.955249 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.955090    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy"
Jul 21 17:03:23.957215 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.957199    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:23.959810 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.959774    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 17:03:23.959943 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.959808    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-981b1e-openshift-default-dockercfg-d2wr5\""
Jul 21 17:03:23.971612 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.971587    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"]
Jul 21 17:03:23.996043 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:23.996018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:24.021371 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-envoy\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btrft\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-kube-api-access-btrft\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-credential-socket\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-certs\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-socket\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-data\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-podinfo\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-token\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.021661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.021619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36d8a46-5155-4b9e-b31d-e5c641e314da-istiod-ca-cert\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.094902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.094863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:24.122511 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-envoy\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122642 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btrft\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-kube-api-access-btrft\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122642 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-credential-socket\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122749 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-certs\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122800 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-socket\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122800 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-data\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-podinfo\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-token\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36d8a46-5155-4b9e-b31d-e5c641e314da-istiod-ca-cert\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.122902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-credential-socket\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.123099 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.122994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-certs\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.123155 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.123093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-socket\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.123155 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.123123    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-data\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.123479 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.123462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36d8a46-5155-4b9e-b31d-e5c641e314da-istiod-ca-cert\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.124918 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.124894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-envoy\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.125564 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.125546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-podinfo\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.132506 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.132478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-token\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.132703 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.132685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btrft\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-kube-api-access-btrft\") pod \"e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") " pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.267524 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.267491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:24.403234 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.403060    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"]
Jul 21 17:03:24.405400 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:03:24.405375    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36d8a46_5155_4b9e_b31d_e5c641e314da.slice/crio-b825e22e1cea30f17f72879604eeb516886b55c0674f43db8319cd29defca4fa WatchSource:0}: Error finding container b825e22e1cea30f17f72879604eeb516886b55c0674f43db8319cd29defca4fa: Status 404 returned error can't find the container with id b825e22e1cea30f17f72879604eeb516886b55c0674f43db8319cd29defca4fa
Jul 21 17:03:24.407470 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.407436    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:24.407581 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.407519    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:24.407581 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:24.407562    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:25.257405 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:25.257367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" event={"ID":"a36d8a46-5155-4b9e-b31d-e5c641e314da","Type":"ContainerStarted","Data":"8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"}
Jul 21 17:03:25.257405 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:25.257412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" event={"ID":"a36d8a46-5155-4b9e-b31d-e5c641e314da","Type":"ContainerStarted","Data":"b825e22e1cea30f17f72879604eeb516886b55c0674f43db8319cd29defca4fa"}
Jul 21 17:03:25.268007 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:25.267984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:25.272780 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:25.272759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:25.279375 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:25.279330    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" podStartSLOduration=2.279318491 podStartE2EDuration="2.279318491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:25.278031465 +0000 UTC m=+2127.546024139" watchObservedRunningTime="2026-07-21 17:03:25.279318491 +0000 UTC m=+2127.547311164"
Jul 21 17:03:26.261415 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:26.261380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:26.262464 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:26.262447    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:27.182765 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:27.182721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:27.283051 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:27.283022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:27.360573 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:27.360531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:27.613461 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:27.613430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:27.872082 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:27.871994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:27.970512 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:27.970476    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:31.710368 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:31.710334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:32.041949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.041912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:32.359807 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.359724    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"]
Jul 21 17:03:32.360132 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.360120    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy"
Jul 21 17:03:32.360201 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.360134    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2e3130-8e94-42ab-bc74-457fa9bd1419" containerName="istio-proxy"
Jul 21 17:03:32.362616 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.362598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.368472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.368427    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fe1af7-openshift-default-dockercfg-282mj\""
Jul 21 17:03:32.388527 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.388499    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"]
Jul 21 17:03:32.399561 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-envoy\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399720 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-certs\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399720 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/befbf94d-0cce-46f0-972c-6344cc17949a-istio-podinfo\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399720 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/befbf94d-0cce-46f0-972c-6344cc17949a-istiod-ca-cert\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399720 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-socket\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399720 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-data\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399962 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-credential-socket\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399962 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-istio-token\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.399962 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.399870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqjgw\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-kube-api-access-lqjgw\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.401784 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.401755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:32.500559 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-certs\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.500751 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/befbf94d-0cce-46f0-972c-6344cc17949a-istio-podinfo\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.500751 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/befbf94d-0cce-46f0-972c-6344cc17949a-istiod-ca-cert\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.500751 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-socket\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.500751 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-data\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.500751 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-credential-socket\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501048 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-istio-token\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501048 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqjgw\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-kube-api-access-lqjgw\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501048 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.500998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-certs\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501048 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.501001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-envoy\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501248 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.501082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-data\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.501354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-socket\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501422 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.501383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-credential-socket\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.501497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.501474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/befbf94d-0cce-46f0-972c-6344cc17949a-istiod-ca-cert\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.503571 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.503548    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-envoy\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.503678 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.503664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/befbf94d-0cce-46f0-972c-6344cc17949a-istio-podinfo\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.509655 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.509633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-istio-token\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.509761 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.509720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqjgw\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-kube-api-access-lqjgw\") pod \"e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") " pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.674062 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.673966    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:32.792340 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.792302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:32.824371 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.824342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"]
Jul 21 17:03:32.826267 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:03:32.826240    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefbf94d_0cce_46f0_972c_6344cc17949a.slice/crio-b18ac807cdcd57c26b9d7d7ab99c8c70d483aaa26a24872d14d634550fe3e29e WatchSource:0}: Error finding container b18ac807cdcd57c26b9d7d7ab99c8c70d483aaa26a24872d14d634550fe3e29e: Status 404 returned error can't find the container with id b18ac807cdcd57c26b9d7d7ab99c8c70d483aaa26a24872d14d634550fe3e29e
Jul 21 17:03:32.828719 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.828691    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:32.828807 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.828754    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:32.828807 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:32.828784    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:33.300937 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:33.300900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" event={"ID":"befbf94d-0cce-46f0-972c-6344cc17949a","Type":"ContainerStarted","Data":"7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"}
Jul 21 17:03:33.301148 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:33.300961    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" event={"ID":"befbf94d-0cce-46f0-972c-6344cc17949a","Type":"ContainerStarted","Data":"b18ac807cdcd57c26b9d7d7ab99c8c70d483aaa26a24872d14d634550fe3e29e"}
Jul 21 17:03:33.344335 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:33.344275    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podStartSLOduration=1.344256675 podStartE2EDuration="1.344256675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:33.340504345 +0000 UTC m=+2135.608497019" watchObservedRunningTime="2026-07-21 17:03:33.344256675 +0000 UTC m=+2135.612249348"
Jul 21 17:03:33.675073 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:33.674972    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:33.679916 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:33.679890    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:34.305817 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:34.305787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:34.306810 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:34.306791    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:34.569563 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:34.569482    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:03:35.606510 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:35.606477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:35.702721 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:35.702689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:35.978386 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:35.978292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:36.076083 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:36.076055    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:39.788763 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:39.788735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:42.303402 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:42.303345    2575 patch_prober.go:28] interesting pod/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 17:03:42.303916 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:42.303419    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 17:03:43.355997 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:43.355959    2575 generic.go:356] "Generic (PLEG): container finished" podID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerID="8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b" exitCode=0
Jul 21 17:03:43.356472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:43.356032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" event={"ID":"a36d8a46-5155-4b9e-b31d-e5c641e314da","Type":"ContainerDied","Data":"8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"}
Jul 21 17:03:43.356526 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:43.356484    2575 scope.go:117] "RemoveContainer" containerID="8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"
Jul 21 17:03:43.357535 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:43.357479    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:43.357604 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:43.357554    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:43.357604 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:43.357589    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:44.365983 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:44.365941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" event={"ID":"a36d8a46-5155-4b9e-b31d-e5c641e314da","Type":"ContainerStarted","Data":"63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e"}
Jul 21 17:03:45.268700 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:45.268659    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:45.269011 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:45.268741    2575 patch_prober.go:28] interesting pod/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 21 17:03:45.269211 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:45.269158    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 21 17:03:45.876094 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:45.876059    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:03:46.268116 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:46.268069    2575 patch_prober.go:28] interesting pod/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 21 17:03:46.268378 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:46.268138    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 21 17:03:47.268591 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:47.268547    2575 patch_prober.go:28] interesting pod/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 21 17:03:47.269059 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:47.268611    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 21 17:03:48.271480 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:48.271451    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:48.271875 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:48.271805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:48.272579 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:48.272562    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:03:48.710448 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:48.710358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:48.804212 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:48.804181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:49.872697 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:49.871965    2575 patch_prober.go:28] interesting pod/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:48782->10.132.0.48:15021: read: connection reset by peer" start-of-body=
Jul 21 17:03:49.872697 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:49.872028    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:48782->10.132.0.48:15021: read: connection reset by peer"
Jul 21 17:03:50.099017 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.098933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:50.402311 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.402278    2575 generic.go:356] "Generic (PLEG): container finished" podID="befbf94d-0cce-46f0-972c-6344cc17949a" containerID="7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91" exitCode=0
Jul 21 17:03:50.402486 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.402321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" event={"ID":"befbf94d-0cce-46f0-972c-6344cc17949a","Type":"ContainerDied","Data":"7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"}
Jul 21 17:03:50.402729 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.402711    2575 scope.go:117] "RemoveContainer" containerID="7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"
Jul 21 17:03:50.403741 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.403713    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:50.403859 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.403794    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:50.403859 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:50.403839    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:03:51.408483 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:51.408445    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" event={"ID":"befbf94d-0cce-46f0-972c-6344cc17949a","Type":"ContainerStarted","Data":"953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5"}
Jul 21 17:03:51.675290 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:51.675195    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:51.675446 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:51.675431    2575 patch_prober.go:28] interesting pod/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 17:03:51.675502 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:51.675481    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 17:03:52.674929 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:52.674893    2575 patch_prober.go:28] interesting pod/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 17:03:52.675336 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:52.674952    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 17:03:53.674722 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:53.674687    2575 patch_prober.go:28] interesting pod/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 17:03:53.674901 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:53.674742    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 17:03:54.464668 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:54.464631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:03:54.674920 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:54.674883    2575 patch_prober.go:28] interesting pod/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 17:03:54.675097 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:54.674944    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 17:03:55.678358 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:55.678326    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:55.678822 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:55.678611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:55.679350 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:55.679333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:03:56.784756 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:56.784719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:56.898299 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:03:56.898264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:14.363712 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:14.363670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:30.765709 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.765678    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"]
Jul 21 17:04:30.768609 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.768585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.771296 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.771272    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fe1af7\"/\"openshift-service-ca.crt\""
Jul 21 17:04:30.772084 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.772066    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fe1af7\"/\"default-dockercfg-km6bd\""
Jul 21 17:04:30.772084 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.772082    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fe1af7\"/\"kube-root-ca.crt\""
Jul 21 17:04:30.772262 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.772193    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fe1af7\"/\"test-model-fe1af7-kserve-self-signed-certs\""
Jul 21 17:04:30.781309 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.781285    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"]
Jul 21 17:04:30.797685 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.797640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:30.834023 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.833985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-dshm\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.834195 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.834027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-tmp-dir\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.834195 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.834045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvtt\" (UniqueName: \"kubernetes.io/projected/fa770cbd-5342-4641-85f7-c361c773ca0e-kube-api-access-4tvtt\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.834195 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.834074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-model-cache\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.834195 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.834124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa770cbd-5342-4641-85f7-c361c773ca0e-tls-certs\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.834195 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.834147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-home\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935180 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa770cbd-5342-4641-85f7-c361c773ca0e-tls-certs\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935363 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-home\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935363 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-dshm\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935363 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-tmp-dir\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935363 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvtt\" (UniqueName: \"kubernetes.io/projected/fa770cbd-5342-4641-85f7-c361c773ca0e-kube-api-access-4tvtt\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935543 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-model-cache\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935614 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-home\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935670 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-tmp-dir\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.935727 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.935691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-model-cache\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.937789 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.937760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-dshm\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.937898 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.937864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa770cbd-5342-4641-85f7-c361c773ca0e-tls-certs\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:30.946991 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:30.946968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvtt\" (UniqueName: \"kubernetes.io/projected/fa770cbd-5342-4641-85f7-c361c773ca0e-kube-api-access-4tvtt\") pod \"test-model-fe1af7-kserve-b48d465c7-j449z\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") " pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:31.078535 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:31.078445    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:31.213812 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:31.213789    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"]
Jul 21 17:04:31.216126 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:04:31.216085    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa770cbd_5342_4641_85f7_c361c773ca0e.slice/crio-10fe64aae69611312bdbe8a5df74dda29513c785f422c1d312495894e4b6a465 WatchSource:0}: Error finding container 10fe64aae69611312bdbe8a5df74dda29513c785f422c1d312495894e4b6a465: Status 404 returned error can't find the container with id 10fe64aae69611312bdbe8a5df74dda29513c785f422c1d312495894e4b6a465
Jul 21 17:04:31.607237 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:31.607194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z" event={"ID":"fa770cbd-5342-4641-85f7-c361c773ca0e","Type":"ContainerStarted","Data":"5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4"}
Jul 21 17:04:31.607237 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:31.607243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z" event={"ID":"fa770cbd-5342-4641-85f7-c361c773ca0e","Type":"ContainerStarted","Data":"10fe64aae69611312bdbe8a5df74dda29513c785f422c1d312495894e4b6a465"}
Jul 21 17:04:31.626240 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:31.626195    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z" podStartSLOduration=1.6261604109999999 podStartE2EDuration="1.626160411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:04:31.624574382 +0000 UTC m=+2193.892567055" watchObservedRunningTime="2026-07-21 17:04:31.626160411 +0000 UTC m=+2193.894153084"
Jul 21 17:04:36.662478 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:36.662440    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:04:41.078722 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:41.078678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:41.078722 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:41.078723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:41.091268 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:41.091237    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:04:41.666308 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:04:41.666274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:05:14.614661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:14.614622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:15.528469 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:15.528432    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"]
Jul 21 17:05:15.552062 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:15.552035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:16.284395 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:16.284356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:16.387628 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:16.387597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:19.669965 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:19.669886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:05:26.117363 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:26.117323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:30.549551 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.549513    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z" podUID="fa770cbd-5342-4641-85f7-c361c773ca0e" containerName="main" containerID="cri-o://5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4" gracePeriod=45
Jul 21 17:05:30.773301 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.773259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:30.809260 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.809194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:05:30.851357 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851316    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-dshm\") pod \"fa770cbd-5342-4641-85f7-c361c773ca0e\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") "
Jul 21 17:05:30.851357 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851360    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-model-cache\") pod \"fa770cbd-5342-4641-85f7-c361c773ca0e\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") "
Jul 21 17:05:30.851607 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851411    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tvtt\" (UniqueName: \"kubernetes.io/projected/fa770cbd-5342-4641-85f7-c361c773ca0e-kube-api-access-4tvtt\") pod \"fa770cbd-5342-4641-85f7-c361c773ca0e\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") "
Jul 21 17:05:30.851607 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851437    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-home\") pod \"fa770cbd-5342-4641-85f7-c361c773ca0e\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") "
Jul 21 17:05:30.851607 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851483    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa770cbd-5342-4641-85f7-c361c773ca0e-tls-certs\") pod \"fa770cbd-5342-4641-85f7-c361c773ca0e\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") "
Jul 21 17:05:30.851607 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851531    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-tmp-dir\") pod \"fa770cbd-5342-4641-85f7-c361c773ca0e\" (UID: \"fa770cbd-5342-4641-85f7-c361c773ca0e\") "
Jul 21 17:05:30.851833 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851698    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "fa770cbd-5342-4641-85f7-c361c773ca0e" (UID: "fa770cbd-5342-4641-85f7-c361c773ca0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:30.851833 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-home" (OuterVolumeSpecName: "home") pod "fa770cbd-5342-4641-85f7-c361c773ca0e" (UID: "fa770cbd-5342-4641-85f7-c361c773ca0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:30.851949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851848    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-model-cache\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:30.851949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851864    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-home\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:30.851949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.851895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fa770cbd-5342-4641-85f7-c361c773ca0e" (UID: "fa770cbd-5342-4641-85f7-c361c773ca0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:30.853901 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.853875    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa770cbd-5342-4641-85f7-c361c773ca0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fa770cbd-5342-4641-85f7-c361c773ca0e" (UID: "fa770cbd-5342-4641-85f7-c361c773ca0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:05:30.854068 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.854050    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa770cbd-5342-4641-85f7-c361c773ca0e-kube-api-access-4tvtt" (OuterVolumeSpecName: "kube-api-access-4tvtt") pod "fa770cbd-5342-4641-85f7-c361c773ca0e" (UID: "fa770cbd-5342-4641-85f7-c361c773ca0e"). InnerVolumeSpecName "kube-api-access-4tvtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:30.854131 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.854051    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-dshm" (OuterVolumeSpecName: "dshm") pod "fa770cbd-5342-4641-85f7-c361c773ca0e" (UID: "fa770cbd-5342-4641-85f7-c361c773ca0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:30.900534 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.900498    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa770cbd-5342-4641-85f7-c361c773ca0e" containerID="5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4" exitCode=0
Jul 21 17:05:30.900730 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.900560    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"
Jul 21 17:05:30.900730 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.900582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z" event={"ID":"fa770cbd-5342-4641-85f7-c361c773ca0e","Type":"ContainerDied","Data":"5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4"}
Jul 21 17:05:30.900730 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.900635    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z" event={"ID":"fa770cbd-5342-4641-85f7-c361c773ca0e","Type":"ContainerDied","Data":"10fe64aae69611312bdbe8a5df74dda29513c785f422c1d312495894e4b6a465"}
Jul 21 17:05:30.900730 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.900658    2575 scope.go:117] "RemoveContainer" containerID="5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4"
Jul 21 17:05:30.909987 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.909969    2575 scope.go:117] "RemoveContainer" containerID="5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4"
Jul 21 17:05:30.910293 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:05:30.910273    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4\": container with ID starting with 5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4 not found: ID does not exist" containerID="5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4"
Jul 21 17:05:30.910350 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.910303    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4"} err="failed to get container status \"5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4\": rpc error: code = NotFound desc = could not find container \"5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4\": container with ID starting with 5444033c5479e75dd2d377e0104251c5ee2f236fd4a4005a8adc10a8c547e9f4 not found: ID does not exist"
Jul 21 17:05:30.924541 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.924517    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"]
Jul 21 17:05:30.930148 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.930127    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fe1af7/test-model-fe1af7-kserve-b48d465c7-j449z"]
Jul 21 17:05:30.952739 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.952714    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tvtt\" (UniqueName: \"kubernetes.io/projected/fa770cbd-5342-4641-85f7-c361c773ca0e-kube-api-access-4tvtt\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:30.952739 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.952739    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa770cbd-5342-4641-85f7-c361c773ca0e-tls-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:30.952899 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.952770    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-tmp-dir\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:30.952899 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:30.952778    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa770cbd-5342-4641-85f7-c361c773ca0e-dshm\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:31.294462 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:31.294429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:32.245212 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:32.245158    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa770cbd-5342-4641-85f7-c361c773ca0e" path="/var/lib/kubelet/pods/fa770cbd-5342-4641-85f7-c361c773ca0e/volumes"
Jul 21 17:05:35.468514 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:35.468480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:05:37.296062 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:37.296020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:37.360042 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:37.360007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:37.551269 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:37.551183    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"]
Jul 21 17:05:37.551514 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:37.551491    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy" containerID="cri-o://63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e" gracePeriod=30
Jul 21 17:05:37.577936 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:37.577909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:37.801399 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:37.801308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:38.480878 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:38.480844    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:38.578520 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:38.578490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:42.815598 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.815533    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:05:42.960330 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960296    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36d8a46-5155-4b9e-b31d-e5c641e314da-istiod-ca-cert\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960330 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960332    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-socket\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960378    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-podinfo\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960425    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-data\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960556    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-envoy\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960732 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960636    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-credential-socket\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960732 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960663    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btrft\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-kube-api-access-btrft\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960732 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960706    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:42.960898 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960755    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-certs\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960898 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960781    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-token\") pod \"a36d8a46-5155-4b9e-b31d-e5c641e314da\" (UID: \"a36d8a46-5155-4b9e-b31d-e5c641e314da\") "
Jul 21 17:05:42.960898 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960741    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36d8a46-5155-4b9e-b31d-e5c641e314da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:42.961043 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.960958    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:42.961124 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.961099    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:42.961375 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.961110    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36d8a46-5155-4b9e-b31d-e5c641e314da-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:42.961375 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.961155    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:42.961375 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.961199    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:42.961539 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.961419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-data" (OuterVolumeSpecName: "istio-data") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:42.962761 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.962731    2575 generic.go:356] "Generic (PLEG): container finished" podID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerID="63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e" exitCode=0
Jul 21 17:05:42.962887 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.962834    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"
Jul 21 17:05:42.962964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.962886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" event={"ID":"a36d8a46-5155-4b9e-b31d-e5c641e314da","Type":"ContainerDied","Data":"63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e"}
Jul 21 17:05:42.963022 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.962973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2" event={"ID":"a36d8a46-5155-4b9e-b31d-e5c641e314da","Type":"ContainerDied","Data":"b825e22e1cea30f17f72879604eeb516886b55c0674f43db8319cd29defca4fa"}
Jul 21 17:05:42.963022 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.963007    2575 scope.go:117] "RemoveContainer" containerID="63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e"
Jul 21 17:05:42.963592 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.963538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-token" (OuterVolumeSpecName: "istio-token") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:42.963592 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.963565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-kube-api-access-btrft" (OuterVolumeSpecName: "kube-api-access-btrft") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "kube-api-access-btrft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:05:42.963837 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.963810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:05:42.964038 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.964017    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a36d8a46-5155-4b9e-b31d-e5c641e314da" (UID: "a36d8a46-5155-4b9e-b31d-e5c641e314da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:05:42.984551 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.984525    2575 scope.go:117] "RemoveContainer" containerID="8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"
Jul 21 17:05:42.993425 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.993403    2575 scope.go:117] "RemoveContainer" containerID="63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e"
Jul 21 17:05:42.993749 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:05:42.993720    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e\": container with ID starting with 63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e not found: ID does not exist" containerID="63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e"
Jul 21 17:05:42.993799 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.993760    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e"} err="failed to get container status \"63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e\": rpc error: code = NotFound desc = could not find container \"63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e\": container with ID starting with 63397afb6a7f8ad76bf2f3a3ca888cdb7100baa97e340bca8f47f30a04a8b51e not found: ID does not exist"
Jul 21 17:05:42.993799 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.993782    2575 scope.go:117] "RemoveContainer" containerID="8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"
Jul 21 17:05:42.994059 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:05:42.994035    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b\": container with ID starting with 8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b not found: ID does not exist" containerID="8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"
Jul 21 17:05:42.994105 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:42.994070    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b"} err="failed to get container status \"8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b\": rpc error: code = NotFound desc = could not find container \"8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b\": container with ID starting with 8015ef866077898cf6c86b0d0c1325db37d138f6434bc4e2c5add4c271dac36b not found: ID does not exist"
Jul 21 17:05:43.062089 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.062057    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:43.062089 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.062082    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:43.062089 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.062091    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:43.062089 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.062098    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:43.062374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.062105    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36d8a46-5155-4b9e-b31d-e5c641e314da-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:43.062374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.062113    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btrft\" (UniqueName: \"kubernetes.io/projected/a36d8a46-5155-4b9e-b31d-e5c641e314da-kube-api-access-btrft\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:05:43.288944 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.288906    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"]
Jul 21 17:05:43.294725 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:43.294701    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-981b1e-openshift-default-6f9459457-mrvz2"]
Jul 21 17:05:44.244880 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:44.244844    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" path="/var/lib/kubelet/pods/a36d8a46-5155-4b9e-b31d-e5c641e314da/volumes"
Jul 21 17:05:48.412596 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:48.412564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:51.354615 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:51.354570    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:05:52.996550 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:52.996512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:53.369972 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:53.369885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:59.228896 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:59.228863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:59.329902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:59.329843    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:59.548826 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:59.548794    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"]
Jul 21 17:05:59.549025 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:59.549004    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy" containerID="cri-o://953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5" gracePeriod=30
Jul 21 17:05:59.618810 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:59.618777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:59.755854 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:05:59.755820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:00.073909 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.073872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:00.403605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.403528    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"]
Jul 21 17:06:00.404026 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404012    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy"
Jul 21 17:06:00.404069 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404029    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy"
Jul 21 17:06:00.404069 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404042    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa770cbd-5342-4641-85f7-c361c773ca0e" containerName="main"
Jul 21 17:06:00.404069 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404050    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa770cbd-5342-4641-85f7-c361c773ca0e" containerName="main"
Jul 21 17:06:00.404069 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404067    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy"
Jul 21 17:06:00.404227 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404075    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy"
Jul 21 17:06:00.404227 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404195    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa770cbd-5342-4641-85f7-c361c773ca0e" containerName="main"
Jul 21 17:06:00.404227 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404206    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy"
Jul 21 17:06:00.404227 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.404215    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36d8a46-5155-4b9e-b31d-e5c641e314da" containerName="istio-proxy"
Jul 21 17:06:00.407902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.407883    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.410572 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.410555    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-927131-openshift-default-dockercfg-87b99\""
Jul 21 17:06:00.422794 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.422772    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"]
Jul 21 17:06:00.515922 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.515891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-certs\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516114 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.515930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-podinfo\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516114 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.515973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-envoy\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516114 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.515999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-data\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516114 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.516042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-credential-socket\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516114 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.516061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-token\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516415 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.516127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j9gr\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-kube-api-access-8j9gr\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516415 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.516208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-socket\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.516415 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.516235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90fcb80e-2e31-4981-a3c4-040f4509f910-istiod-ca-cert\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.599657 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.599626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:00.617574 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j9gr\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-kube-api-access-8j9gr\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.617674 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-socket\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.617674 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90fcb80e-2e31-4981-a3c4-040f4509f910-istiod-ca-cert\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.617779 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-certs\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.617779 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-podinfo\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.617779 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-envoy\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.617779 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-data\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618007 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-credential-socket\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618007 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.617857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-token\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618133 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.618008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-socket\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.618349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90fcb80e-2e31-4981-a3c4-040f4509f910-istiod-ca-cert\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618482 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.618368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-certs\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618482 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.618444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-data\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.618482 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.618462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-credential-socket\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.620578 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.620555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-envoy\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.620687 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.620583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-podinfo\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.627361 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.627338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j9gr\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-kube-api-access-8j9gr\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.627544 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.627528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-token\") pod \"e2e-api-a-927131-openshift-default-7875645d6f-p562j\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") " pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.718340 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.718266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:00.856343 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.856318    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"]
Jul 21 17:06:00.858482 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:06:00.858459    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fcb80e_2e31_4981_a3c4_040f4509f910.slice/crio-1edf32d37653aab7ee1ceada5ec98d56d1ee99edebc22f30132723aa8cad173b WatchSource:0}: Error finding container 1edf32d37653aab7ee1ceada5ec98d56d1ee99edebc22f30132723aa8cad173b: Status 404 returned error can't find the container with id 1edf32d37653aab7ee1ceada5ec98d56d1ee99edebc22f30132723aa8cad173b
Jul 21 17:06:00.863782 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.863742    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:00.863890 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.863828    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:00.863890 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:00.863863    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:01.050056 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:01.050017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" event={"ID":"90fcb80e-2e31-4981-a3c4-040f4509f910","Type":"ContainerStarted","Data":"1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"}
Jul 21 17:06:01.050278 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:01.050085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" event={"ID":"90fcb80e-2e31-4981-a3c4-040f4509f910","Type":"ContainerStarted","Data":"1edf32d37653aab7ee1ceada5ec98d56d1ee99edebc22f30132723aa8cad173b"}
Jul 21 17:06:01.072522 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:01.072477    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podStartSLOduration=1.072459649 podStartE2EDuration="1.072459649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:01.071493788 +0000 UTC m=+2283.339486781" watchObservedRunningTime="2026-07-21 17:06:01.072459649 +0000 UTC m=+2283.340452329"
Jul 21 17:06:01.255499 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:01.255467    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:01.718612 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:01.718571    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:01.723469 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:01.723443    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:02.054733 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:02.054698    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:02.055800 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:02.055783    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:03.113221 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:03.113187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:03.210579 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:03.210544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:03.551695 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:03.551669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:03.645369 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:03.645342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:03.817565 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:03.817484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:03.919859 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:03.919824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:04.798103 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.798080    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:06:04.859039 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.858969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-socket\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859039 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859005    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/befbf94d-0cce-46f0-972c-6344cc17949a-istio-podinfo\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859039 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859026    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-certs\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859055    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-envoy\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859087    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/befbf94d-0cce-46f0-972c-6344cc17949a-istiod-ca-cert\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859115    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-istio-token\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859203    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-credential-socket\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859224    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqjgw\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-kube-api-access-lqjgw\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859254    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-data\") pod \"befbf94d-0cce-46f0-972c-6344cc17949a\" (UID: \"befbf94d-0cce-46f0-972c-6344cc17949a\") "
Jul 21 17:06:04.859304 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859295    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:04.859665 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859314    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:04.859665 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859516    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.859665 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859537    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.859665 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859520    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:04.859665 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.859610    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/befbf94d-0cce-46f0-972c-6344cc17949a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:04.860276 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.860225    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-data" (OuterVolumeSpecName: "istio-data") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:04.861501 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.861480    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/befbf94d-0cce-46f0-972c-6344cc17949a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:06:04.861597 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.861543    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-istio-token" (OuterVolumeSpecName: "istio-token") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:04.861877 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.861860    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:04.861930 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.861881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-kube-api-access-lqjgw" (OuterVolumeSpecName: "kube-api-access-lqjgw") pod "befbf94d-0cce-46f0-972c-6344cc17949a" (UID: "befbf94d-0cce-46f0-972c-6344cc17949a"). InnerVolumeSpecName "kube-api-access-lqjgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:04.960570 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960543    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.960570 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960567    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/befbf94d-0cce-46f0-972c-6344cc17949a-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.960570 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960575    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.960774 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960583    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.960774 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960594    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqjgw\" (UniqueName: \"kubernetes.io/projected/befbf94d-0cce-46f0-972c-6344cc17949a-kube-api-access-lqjgw\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.960774 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960603    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/befbf94d-0cce-46f0-972c-6344cc17949a-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:04.960774 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:04.960610    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/befbf94d-0cce-46f0-972c-6344cc17949a-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:05.069570 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.069534    2575 generic.go:356] "Generic (PLEG): container finished" podID="befbf94d-0cce-46f0-972c-6344cc17949a" containerID="953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5" exitCode=0
Jul 21 17:06:05.069702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.069583    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"
Jul 21 17:06:05.069702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.069616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" event={"ID":"befbf94d-0cce-46f0-972c-6344cc17949a","Type":"ContainerDied","Data":"953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5"}
Jul 21 17:06:05.069702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.069667    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh" event={"ID":"befbf94d-0cce-46f0-972c-6344cc17949a","Type":"ContainerDied","Data":"b18ac807cdcd57c26b9d7d7ab99c8c70d483aaa26a24872d14d634550fe3e29e"}
Jul 21 17:06:05.069702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.069690    2575 scope.go:117] "RemoveContainer" containerID="953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5"
Jul 21 17:06:05.079449 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.079433    2575 scope.go:117] "RemoveContainer" containerID="7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"
Jul 21 17:06:05.087275 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.087260    2575 scope.go:117] "RemoveContainer" containerID="953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5"
Jul 21 17:06:05.087532 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:06:05.087515    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5\": container with ID starting with 953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5 not found: ID does not exist" containerID="953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5"
Jul 21 17:06:05.087605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.087548    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5"} err="failed to get container status \"953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5\": rpc error: code = NotFound desc = could not find container \"953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5\": container with ID starting with 953ec5b664c136da36613667556f900fc568537c67465711a0b8c5b22a302bb5 not found: ID does not exist"
Jul 21 17:06:05.087605 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.087571    2575 scope.go:117] "RemoveContainer" containerID="7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"
Jul 21 17:06:05.087796 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:06:05.087779    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91\": container with ID starting with 7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91 not found: ID does not exist" containerID="7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"
Jul 21 17:06:05.087834 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.087803    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91"} err="failed to get container status \"7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91\": rpc error: code = NotFound desc = could not find container \"7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91\": container with ID starting with 7ea119ddc598fc91fc7f6a11775fbcd6192d0a19149fb8ce4926f5b272e01a91 not found: ID does not exist"
Jul 21 17:06:05.097745 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.097725    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"]
Jul 21 17:06:05.103443 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:05.103421    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fe1af7-openshift-default-64545bc5bc-225rh"]
Jul 21 17:06:06.245282 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:06.245248    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" path="/var/lib/kubelet/pods/befbf94d-0cce-46f0-972c-6344cc17949a/volumes"
Jul 21 17:06:07.592522 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:07.592487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:08.027147 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.027109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:08.280662 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.280575    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"]
Jul 21 17:06:08.280964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.280952    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy"
Jul 21 17:06:08.281009 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.280966    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy"
Jul 21 17:06:08.281009 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.280977    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy"
Jul 21 17:06:08.281009 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.280982    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy"
Jul 21 17:06:08.281098 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.281041    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy"
Jul 21 17:06:08.281098 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.281051    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="befbf94d-0cce-46f0-972c-6344cc17949a" containerName="istio-proxy"
Jul 21 17:06:08.284577 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.284554    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.287537 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.287511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6f8407-openshift-default-dockercfg-pcsdm\""
Jul 21 17:06:08.298158 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.298126    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"]
Jul 21 17:06:08.313295 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.313270    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:08.385698 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-data\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.385931 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-socket\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.385931 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-credential-socket\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.385931 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-token\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.385931 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-podinfo\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.386144 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724886a-62fa-42c0-a45b-959870dcd0bc-istiod-ca-cert\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.386144 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.385970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-envoy\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.386144 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.386018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dsf\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-kube-api-access-j7dsf\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.386144 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.386091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-certs\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487276 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-token\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487465 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-podinfo\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487465 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724886a-62fa-42c0-a45b-959870dcd0bc-istiod-ca-cert\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487465 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-envoy\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487465 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dsf\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-kube-api-access-j7dsf\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487465 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-certs\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487465 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-data\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487791 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-socket\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487791 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487515    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-credential-socket\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.487933 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487897    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-credential-socket\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.488031 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.487932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-certs\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.488115 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.488062    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724886a-62fa-42c0-a45b-959870dcd0bc-istiod-ca-cert\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.488362 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.488338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-data\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.488493 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.488380    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-socket\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.490337 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.490311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-podinfo\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.490808 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.490786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-envoy\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.496305 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.496280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dsf\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-kube-api-access-j7dsf\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.496517 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.496498    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-token\") pod \"e2e-api-b-6f8407-openshift-default-845b845787-ts2g2\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") " pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.562723 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.562633    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:08.594620 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.594591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:08.744462 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.744440    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"]
Jul 21 17:06:08.746141 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:06:08.746110    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0724886a_62fa_42c0_a45b_959870dcd0bc.slice/crio-d0eec19c9bcd47aac3adaac2bd3ebb7395b9f7e15f993f0cf932ffcdc0fe37b1 WatchSource:0}: Error finding container d0eec19c9bcd47aac3adaac2bd3ebb7395b9f7e15f993f0cf932ffcdc0fe37b1: Status 404 returned error can't find the container with id d0eec19c9bcd47aac3adaac2bd3ebb7395b9f7e15f993f0cf932ffcdc0fe37b1
Jul 21 17:06:08.748206 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.748157    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:08.748313 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.748254    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:08.748313 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:08.748301    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:09.088434 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:09.088402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" event={"ID":"0724886a-62fa-42c0-a45b-959870dcd0bc","Type":"ContainerStarted","Data":"a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"}
Jul 21 17:06:09.088608 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:09.088449    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" event={"ID":"0724886a-62fa-42c0-a45b-959870dcd0bc","Type":"ContainerStarted","Data":"d0eec19c9bcd47aac3adaac2bd3ebb7395b9f7e15f993f0cf932ffcdc0fe37b1"}
Jul 21 17:06:09.112426 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:09.112380    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podStartSLOduration=1.11236523 podStartE2EDuration="1.11236523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:09.111189581 +0000 UTC m=+2291.379182245" watchObservedRunningTime="2026-07-21 17:06:09.11236523 +0000 UTC m=+2291.380357901"
Jul 21 17:06:09.595250 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:09.595207    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:09.600411 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:09.600386    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:10.093868 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:10.093842    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:10.094732 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:10.094714    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:10.867690 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:10.867656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:06:11.150204 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:11.150107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:11.220834 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:11.220803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:11.324428 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:11.324396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:11.889597 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:11.889567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:11.988336 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:11.988306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:15.477612 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:15.477581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:18.095371 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:18.095335    2575 patch_prober.go:28] interesting pod/e2e-api-a-927131-openshift-default-7875645d6f-p562j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 17:06:18.095797 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:18.095399    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 17:06:20.151242 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:20.151196    2575 generic.go:356] "Generic (PLEG): container finished" podID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerID="1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6" exitCode=0
Jul 21 17:06:20.151689 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:20.151321    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" event={"ID":"90fcb80e-2e31-4981-a3c4-040f4509f910","Type":"ContainerDied","Data":"1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"}
Jul 21 17:06:20.151836 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:20.151816    2575 scope.go:117] "RemoveContainer" containerID="1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"
Jul 21 17:06:20.153130 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:20.153083    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:20.153268 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:20.153190    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:20.153268 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:20.153241    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:21.165928 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:21.165882    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" event={"ID":"90fcb80e-2e31-4981-a3c4-040f4509f910","Type":"ContainerStarted","Data":"5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf"}
Jul 21 17:06:21.718796 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:21.718761    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:21.718994 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:21.718971    2575 patch_prober.go:28] interesting pod/e2e-api-a-927131-openshift-default-7875645d6f-p562j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 21 17:06:21.719048 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:21.719028    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 21 17:06:22.719205 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:22.719143    2575 patch_prober.go:28] interesting pod/e2e-api-a-927131-openshift-default-7875645d6f-p562j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 21 17:06:22.719586 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:22.719245    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 21 17:06:23.719409 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:23.719370    2575 patch_prober.go:28] interesting pod/e2e-api-a-927131-openshift-default-7875645d6f-p562j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 21 17:06:23.719782 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:23.719430    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 21 17:06:23.971139 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:23.971054    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:06:24.029539 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:24.029492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:24.130514 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:24.130486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:24.718720 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:24.718682    2575 patch_prober.go:28] interesting pod/e2e-api-a-927131-openshift-default-7875645d6f-p562j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 21 17:06:24.718936 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:24.718747    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 21 17:06:25.722795 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:25.722763    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:25.723186 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:25.723044    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:25.723661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:25.723646    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:26.135320 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:26.135283    2575 patch_prober.go:28] interesting pod/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 17:06:26.135499 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:26.135333    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 17:06:27.200046 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:27.200016    2575 generic.go:356] "Generic (PLEG): container finished" podID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerID="a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7" exitCode=0
Jul 21 17:06:27.200508 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:27.200087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" event={"ID":"0724886a-62fa-42c0-a45b-959870dcd0bc","Type":"ContainerDied","Data":"a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"}
Jul 21 17:06:27.200573 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:27.200559    2575 scope.go:117] "RemoveContainer" containerID="a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"
Jul 21 17:06:27.201565 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:27.201542    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:27.201616 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:27.201604    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:27.201651 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:27.201636    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:06:28.206977 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:28.206945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" event={"ID":"0724886a-62fa-42c0-a45b-959870dcd0bc","Type":"ContainerStarted","Data":"f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305"}
Jul 21 17:06:28.595667 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:28.595621    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:28.595902 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:28.595876    2575 patch_prober.go:28] interesting pod/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 17:06:28.595982 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:28.595934    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 17:06:29.595180 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:29.595127    2575 patch_prober.go:28] interesting pod/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 17:06:29.595560 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:29.595219    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 17:06:30.595917 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:30.595880    2575 patch_prober.go:28] interesting pod/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 17:06:30.596340 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:30.595948    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 17:06:31.595112 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:31.595076    2575 patch_prober.go:28] interesting pod/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 17:06:31.595311 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:31.595129    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 17:06:32.598729 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:32.598689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:32.599116 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:32.598958    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:32.599653 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:32.599636    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:06:32.758698 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:32.758671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:32.859331 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:32.859235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:38.797321 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:38.797289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:43.509292 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:43.509256    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:43.873366 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:43.873267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:45.362724 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:45.362694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:06:49.649659 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:49.649580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:49.713944 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:49.713914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:49.889653 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:49.889611    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"]
Jul 21 17:06:49.889903 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:49.889877    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy" containerID="cri-o://5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf" gracePeriod=30
Jul 21 17:06:49.913118 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:49.913022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:50.239055 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:50.238964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:51.469109 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:51.469073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:54.817279 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:54.817248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:54.916474 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:54.916449    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:55.141113 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.141087    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:55.272296 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272267    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-podinfo\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272320    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-socket\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272339    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-certs\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272460    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j9gr\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-kube-api-access-8j9gr\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272647 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-credential-socket\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272647 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-envoy\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272647 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272606    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-token\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272647 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272621    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:55.272848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272647    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90fcb80e-2e31-4981-a3c4-040f4509f910-istiod-ca-cert\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272689    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-data\") pod \"90fcb80e-2e31-4981-a3c4-040f4509f910\" (UID: \"90fcb80e-2e31-4981-a3c4-040f4509f910\") "
Jul 21 17:06:55.272848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272644    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:55.272848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.272816    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:55.273067 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.273035    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.273067 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.273054    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.273208 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.273068    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.273346 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.273308    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90fcb80e-2e31-4981-a3c4-040f4509f910-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:06:55.273837 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.273804    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-data" (OuterVolumeSpecName: "istio-data") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:55.274628 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.274606    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:06:55.274979 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.274965    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-token" (OuterVolumeSpecName: "istio-token") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:55.275217 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.275201    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:55.275272 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.275246    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-kube-api-access-8j9gr" (OuterVolumeSpecName: "kube-api-access-8j9gr") pod "90fcb80e-2e31-4981-a3c4-040f4509f910" (UID: "90fcb80e-2e31-4981-a3c4-040f4509f910"). InnerVolumeSpecName "kube-api-access-8j9gr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:55.333281 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.333254    2575 generic.go:356] "Generic (PLEG): container finished" podID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerID="5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf" exitCode=0
Jul 21 17:06:55.333401 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.333303    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"
Jul 21 17:06:55.333401 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.333345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" event={"ID":"90fcb80e-2e31-4981-a3c4-040f4509f910","Type":"ContainerDied","Data":"5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf"}
Jul 21 17:06:55.333472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.333399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j" event={"ID":"90fcb80e-2e31-4981-a3c4-040f4509f910","Type":"ContainerDied","Data":"1edf32d37653aab7ee1ceada5ec98d56d1ee99edebc22f30132723aa8cad173b"}
Jul 21 17:06:55.333472 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.333421    2575 scope.go:117] "RemoveContainer" containerID="5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf"
Jul 21 17:06:55.343207 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.343190    2575 scope.go:117] "RemoveContainer" containerID="1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"
Jul 21 17:06:55.351108 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.351090    2575 scope.go:117] "RemoveContainer" containerID="5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf"
Jul 21 17:06:55.351392 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:06:55.351373    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf\": container with ID starting with 5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf not found: ID does not exist" containerID="5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf"
Jul 21 17:06:55.351450 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.351400    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf"} err="failed to get container status \"5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf\": rpc error: code = NotFound desc = could not find container \"5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf\": container with ID starting with 5cc503257924b95b12fe9b30233a1420de312dec9a5eded14ece7395e48e8fdf not found: ID does not exist"
Jul 21 17:06:55.351450 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.351417    2575 scope.go:117] "RemoveContainer" containerID="1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"
Jul 21 17:06:55.351663 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:06:55.351636    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6\": container with ID starting with 1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6 not found: ID does not exist" containerID="1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"
Jul 21 17:06:55.351705 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.351669    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6"} err="failed to get container status \"1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6\": rpc error: code = NotFound desc = could not find container \"1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6\": container with ID starting with 1cfa1bc5be309b8269bfab2b3da6df6c52ea74020b98026ff62dcd2faafe29d6 not found: ID does not exist"
Jul 21 17:06:55.357694 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.357666    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"]
Jul 21 17:06:55.365069 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.365046    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-927131-openshift-default-7875645d6f-p562j"]
Jul 21 17:06:55.374410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.374358    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.374410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.374379    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.374410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.374388    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j9gr\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-kube-api-access-8j9gr\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.374410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.374397    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.374410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.374407    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90fcb80e-2e31-4981-a3c4-040f4509f910-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:55.374410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:55.374414    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90fcb80e-2e31-4981-a3c4-040f4509f910-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.245427 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:06:56.245391    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" path="/var/lib/kubelet/pods/90fcb80e-2e31-4981-a3c4-040f4509f910/volumes"
Jul 21 17:07:00.814782 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:00.814714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:00.916412 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:00.916372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:06.137872 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:06.137841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:10.316542 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:10.316506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:10.722998 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:10.722912    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:11.485671 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:11.485636    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:07:16.527584 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:16.527546    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:16.629670 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:16.629639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:16.764904 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:16.764870    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"]
Jul 21 17:07:16.765152 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:16.765126    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" containerID="cri-o://f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305" gracePeriod=30
Jul 21 17:07:16.798091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:16.797999    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.069426 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.069337    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.428058 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.427949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.601569 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.601533    2575 patch_prober.go:28] interesting pod/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 17:07:17.601961 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.601603    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:07:17.735702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.735607    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"]
Jul 21 17:07:17.736022 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.736006    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy"
Jul 21 17:07:17.736090 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.736024    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy"
Jul 21 17:07:17.736090 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.736035    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy"
Jul 21 17:07:17.736090 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.736043    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy"
Jul 21 17:07:17.736286 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.736134    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy"
Jul 21 17:07:17.738753 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.738731    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.744298 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.744275    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5b0b89-openshift-default-dockercfg-t9f44\""
Jul 21 17:07:17.765563 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.765525    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"]
Jul 21 17:07:17.786756 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.786710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:17.883734 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-data\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883734 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-envoy\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-certs\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-credential-socket\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-podinfo\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqm7\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-kube-api-access-kvqm7\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-socket\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.883992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.883930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istiod-ca-cert\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.884362 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.884014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-token\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984772 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-data\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-envoy\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-certs\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-credential-socket\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-podinfo\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqm7\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-kube-api-access-kvqm7\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.984964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-socket\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985318 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.984967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istiod-ca-cert\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985318 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.985198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-data\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985318 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.985221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-certs\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985318 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.985253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-token\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985616 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.985596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-credential-socket\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.985797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istiod-ca-cert\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.985973 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.985896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-socket\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.987629 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.987605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-envoy\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.987705 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.987641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-podinfo\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.993559 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.993537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-token\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:17.993735 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:17.993649    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqm7\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-kube-api-access-kvqm7\") pod \"e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") " pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:18.050490 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.050452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:18.200483 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.200455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"]
Jul 21 17:07:18.201937 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:07:18.201912    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e8a1e3_85aa_4da0_9490_a991071aefe0.slice/crio-d1979bde043f8a3029bbd1daa3376a241a1fa562b77fef4f94ff04606f2e9266 WatchSource:0}: Error finding container d1979bde043f8a3029bbd1daa3376a241a1fa562b77fef4f94ff04606f2e9266: Status 404 returned error can't find the container with id d1979bde043f8a3029bbd1daa3376a241a1fa562b77fef4f94ff04606f2e9266
Jul 21 17:07:18.203946 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.203915    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:18.204041 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.203992    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:18.204041 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.204034    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:18.208254 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.208230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:18.453531 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.453489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" event={"ID":"f9e8a1e3-85aa-4da0-9490-a991071aefe0","Type":"ContainerStarted","Data":"14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"}
Jul 21 17:07:18.453708 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.453548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" event={"ID":"f9e8a1e3-85aa-4da0-9490-a991071aefe0","Type":"ContainerStarted","Data":"d1979bde043f8a3029bbd1daa3376a241a1fa562b77fef4f94ff04606f2e9266"}
Jul 21 17:07:18.475744 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:18.475693    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podStartSLOduration=1.475678491 podStartE2EDuration="1.475678491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:18.474306202 +0000 UTC m=+2360.742298875" watchObservedRunningTime="2026-07-21 17:07:18.475678491 +0000 UTC m=+2360.743671165"
Jul 21 17:07:19.050903 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:19.050862    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:19.056586 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:19.056559    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:19.459143 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:19.459054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:19.460159 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:19.460137    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:20.393458 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:20.393418    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:20.484656 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:20.484624    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:20.570058 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:20.570025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:20.839537 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:20.839497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:21.111692 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:21.111594    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:21.276652 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:21.276619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:22.018399 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.018372    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:07:22.118975 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.118891    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-credential-socket\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.118975 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.118927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-data\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.118975 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.118944    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7dsf\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-kube-api-access-j7dsf\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.118975 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.118966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724886a-62fa-42c0-a45b-959870dcd0bc-istiod-ca-cert\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.119324 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119019    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-envoy\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.119324 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119052    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-token\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.119324 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-certs\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.119324 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119126    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-socket\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.119324 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119152    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-podinfo\") pod \"0724886a-62fa-42c0-a45b-959870dcd0bc\" (UID: \"0724886a-62fa-42c0-a45b-959870dcd0bc\") "
Jul 21 17:07:22.119324 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119266    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:22.119619 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119504    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.119619 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119480    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:22.119619 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119541    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:22.119619 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119541    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0724886a-62fa-42c0-a45b-959870dcd0bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:07:22.119872 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.119848    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:22.121587 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.121551    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:07:22.121701 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.121626    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:07:22.121701 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.121643    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-kube-api-access-j7dsf" (OuterVolumeSpecName: "kube-api-access-j7dsf") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "kube-api-access-j7dsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:07:22.121791 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.121698    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "0724886a-62fa-42c0-a45b-959870dcd0bc" (UID: "0724886a-62fa-42c0-a45b-959870dcd0bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:07:22.220296 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220266    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220296 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220292    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7dsf\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-kube-api-access-j7dsf\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220296 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220304    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724886a-62fa-42c0-a45b-959870dcd0bc-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220312    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220320    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220328    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220335    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724886a-62fa-42c0-a45b-959870dcd0bc-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.220528 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.220342    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724886a-62fa-42c0-a45b-959870dcd0bc-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:07:22.476469 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.476384    2575 generic.go:356] "Generic (PLEG): container finished" podID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerID="f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305" exitCode=0
Jul 21 17:07:22.476469 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.476435    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"
Jul 21 17:07:22.476654 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.476470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" event={"ID":"0724886a-62fa-42c0-a45b-959870dcd0bc","Type":"ContainerDied","Data":"f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305"}
Jul 21 17:07:22.476654 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.476527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2" event={"ID":"0724886a-62fa-42c0-a45b-959870dcd0bc","Type":"ContainerDied","Data":"d0eec19c9bcd47aac3adaac2bd3ebb7395b9f7e15f993f0cf932ffcdc0fe37b1"}
Jul 21 17:07:22.476654 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.476559    2575 scope.go:117] "RemoveContainer" containerID="f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305"
Jul 21 17:07:22.485292 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.485276    2575 scope.go:117] "RemoveContainer" containerID="a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"
Jul 21 17:07:22.494151 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.494133    2575 scope.go:117] "RemoveContainer" containerID="f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305"
Jul 21 17:07:22.494466 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:07:22.494449    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305\": container with ID starting with f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305 not found: ID does not exist" containerID="f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305"
Jul 21 17:07:22.494519 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.494461    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"]
Jul 21 17:07:22.494519 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.494474    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305"} err="failed to get container status \"f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305\": rpc error: code = NotFound desc = could not find container \"f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305\": container with ID starting with f7703dd68e00e4b7ee3ca9eb0abe947e6c2f9ea07808b2720140d2e52a976305 not found: ID does not exist"
Jul 21 17:07:22.494519 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.494497    2575 scope.go:117] "RemoveContainer" containerID="a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"
Jul 21 17:07:22.494714 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:07:22.494697    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7\": container with ID starting with a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7 not found: ID does not exist" containerID="a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"
Jul 21 17:07:22.494768 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.494724    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7"} err="failed to get container status \"a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7\": rpc error: code = NotFound desc = could not find container \"a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7\": container with ID starting with a0ff7f88ac2f722c8924bc924882c68a1516aa772c8a82e9b329df02a491a6b7 not found: ID does not exist"
Jul 21 17:07:22.497660 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:22.497640    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6f8407-openshift-default-845b845787-ts2g2"]
Jul 21 17:07:24.244462 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:24.244429    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" path="/var/lib/kubelet/pods/0724886a-62fa-42c0-a45b-959870dcd0bc/volumes"
Jul 21 17:07:24.898087 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:24.898049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:25.251200 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.251137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:25.510944 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.510864    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"]
Jul 21 17:07:25.511274 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.511260    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy"
Jul 21 17:07:25.511335 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.511275    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy"
Jul 21 17:07:25.511335 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.511288    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy"
Jul 21 17:07:25.511335 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.511294    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy"
Jul 21 17:07:25.511491 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.511361    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="90fcb80e-2e31-4981-a3c4-040f4509f910" containerName="istio-proxy"
Jul 21 17:07:25.511491 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.511369    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy"
Jul 21 17:07:25.514356 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.514340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.517262 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.517237    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e17cb5-openshift-default-dockercfg-rsm4g\""
Jul 21 17:07:25.532338 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.532314    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"]
Jul 21 17:07:25.549785 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-credential-socket\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.549940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzrqr\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-kube-api-access-vzrqr\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.549940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-certs\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.549940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-data\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.549940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istiod-ca-cert\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.549940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-podinfo\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.549940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-envoy\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.550294 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-token\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.550294 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.549983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-socket\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.555410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.555390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:25.651127 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istiod-ca-cert\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651127 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-podinfo\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-envoy\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-token\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651374 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-socket\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651549 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-credential-socket\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651549 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzrqr\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-kube-api-access-vzrqr\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651549 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651522    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-certs\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-data\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651762 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-socket\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651888 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-data\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.651968 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.651904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istiod-ca-cert\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.652043 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.652024    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-credential-socket\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.652106 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.652091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-certs\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.653664 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.653647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-envoy\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.654056 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.654041    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-podinfo\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.667807 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.667778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzrqr\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-kube-api-access-vzrqr\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.675416 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.675383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-token\") pod \"e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") " pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.825097 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.825004    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:25.978306 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.978277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"]
Jul 21 17:07:25.980995 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:07:25.980954    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504159c1_2b3b_4831_a1f8_1ff9d24d16cc.slice/crio-63de131f71488d281ed744b45880cd3c9b63e3cf134d34e7e2220466ab67ce7d WatchSource:0}: Error finding container 63de131f71488d281ed744b45880cd3c9b63e3cf134d34e7e2220466ab67ce7d: Status 404 returned error can't find the container with id 63de131f71488d281ed744b45880cd3c9b63e3cf134d34e7e2220466ab67ce7d
Jul 21 17:07:25.983139 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.983110    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:25.983222 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.983199    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:25.983269 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:25.983232    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:26.500376 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:26.500340    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" event={"ID":"504159c1-2b3b-4831-a1f8-1ff9d24d16cc","Type":"ContainerStarted","Data":"ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"}
Jul 21 17:07:26.500767 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:26.500401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" event={"ID":"504159c1-2b3b-4831-a1f8-1ff9d24d16cc","Type":"ContainerStarted","Data":"63de131f71488d281ed744b45880cd3c9b63e3cf134d34e7e2220466ab67ce7d"}
Jul 21 17:07:26.524091 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:26.524039    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podStartSLOduration=1.5240256620000001 podStartE2EDuration="1.524025662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:26.521654549 +0000 UTC m=+2368.789647224" watchObservedRunningTime="2026-07-21 17:07:26.524025662 +0000 UTC m=+2368.792018318"
Jul 21 17:07:26.702226 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:26.702156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:26.825926 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:26.825839    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:27.659001 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:27.658958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:07:27.830783 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:27.830759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:28.425748 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:28.425713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:28.511087 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:28.511018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:28.512050 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:28.512024    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:28.531811 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:28.531785    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:28.630483 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:28.630437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:28.732023 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:28.731937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:29.143266 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:29.143225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:29.243853 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:29.243794    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:32.901002 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:32.900965    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:35.501373 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:35.501332    2575 patch_prober.go:28] interesting pod/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 17:07:35.501848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:35.501397    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 17:07:36.553894 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:36.553863    2575 generic.go:356] "Generic (PLEG): container finished" podID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerID="14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46" exitCode=0
Jul 21 17:07:36.554353 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:36.553953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" event={"ID":"f9e8a1e3-85aa-4da0-9490-a991071aefe0","Type":"ContainerDied","Data":"14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"}
Jul 21 17:07:36.554519 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:36.554503    2575 scope.go:117] "RemoveContainer" containerID="14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"
Jul 21 17:07:36.555612 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:36.555584    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:36.555689 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:36.555654    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:36.555689 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:36.555683    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:37.565109 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:37.565060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" event={"ID":"f9e8a1e3-85aa-4da0-9490-a991071aefe0","Type":"ContainerStarted","Data":"a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696"}
Jul 21 17:07:38.050706 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:38.050665    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:38.051307 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:38.051278    2575 patch_prober.go:28] interesting pod/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 17:07:38.051534 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:38.051507    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 17:07:39.004110 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:39.004070    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:07:39.051124 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:39.051085    2575 patch_prober.go:28] interesting pod/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 17:07:39.051469 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:39.051436    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 17:07:40.050915 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:40.050849    2575 patch_prober.go:28] interesting pod/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 17:07:40.051420 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:40.050938    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 17:07:41.051406 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:41.051362    2575 patch_prober.go:28] interesting pod/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 17:07:41.051825 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:41.051435    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 17:07:41.975924 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:41.975889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:42.054461 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:42.054432    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:42.054924 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:42.054833    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:42.055522 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:42.055499    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:07:42.067808 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:42.067779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:42.146255 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:42.146223    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:43.512837 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.512800    2575 patch_prober.go:28] interesting pod/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 17:07:43.513438 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.512874    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 17:07:43.600845 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.600811    2575 generic.go:356] "Generic (PLEG): container finished" podID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerID="ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464" exitCode=0
Jul 21 17:07:43.601021 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.600889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" event={"ID":"504159c1-2b3b-4831-a1f8-1ff9d24d16cc","Type":"ContainerDied","Data":"ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"}
Jul 21 17:07:43.601393 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.601373    2575 scope.go:117] "RemoveContainer" containerID="ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"
Jul 21 17:07:43.602464 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.602436    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:43.602534 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.602520    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:43.602569 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:43.602559    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 17:07:44.607919 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:44.607887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" event={"ID":"504159c1-2b3b-4831-a1f8-1ff9d24d16cc","Type":"ContainerStarted","Data":"5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e"}
Jul 21 17:07:44.825427 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:44.825396    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:44.825689 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:44.825671    2575 patch_prober.go:28] interesting pod/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 17:07:44.825742 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:44.825715    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 17:07:45.825408 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:45.825368    2575 patch_prober.go:28] interesting pod/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 17:07:45.825874 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:45.825425    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 17:07:46.779353 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:46.779318    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:07:46.825838 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:46.825796    2575 patch_prober.go:28] interesting pod/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 17:07:46.826255 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:46.825855    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 17:07:47.825776 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:47.825743    2575 patch_prober.go:28] interesting pod/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 17:07:47.825969 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:47.825799    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 17:07:48.829695 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:48.829665    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:48.830153 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:48.830053    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:48.830833 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:48.830816    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:07:50.994961 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:50.994931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:51.094334 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:51.094292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:58.359082 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:58.359050    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:07:58.364734 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:58.364708    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:07:59.424003 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.423686    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:59.766875 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.766836    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"]
Jul 21 17:07:59.767333 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.767318    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0724886a-62fa-42c0-a45b-959870dcd0bc" containerName="istio-proxy"
Jul 21 17:07:59.770885 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.770867    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.774395 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.774371    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"openshift-service-ca.crt\""
Jul 21 17:07:59.774395 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.774385    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"default-dockercfg-jhbxf\""
Jul 21 17:07:59.774581 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.774414    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"kube-root-ca.crt\""
Jul 21 17:07:59.774581 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.774423    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"auth-test-model-e17cb5-kserve-self-signed-certs\""
Jul 21 17:07:59.782020 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.781994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"]
Jul 21 17:07:59.789772 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.789748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-dshm\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.789912 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.789777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-model-cache\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.789912 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.789797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-home\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.789992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.789925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d23cc7b-f7a8-4314-9dbe-6137db245901-tls-certs\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.789992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.789951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8tbs\" (UniqueName: \"kubernetes.io/projected/1d23cc7b-f7a8-4314-9dbe-6137db245901-kube-api-access-j8tbs\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.789992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.789972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-tmp-dir\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.862811 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.862773    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:07:59.891009 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.890968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d23cc7b-f7a8-4314-9dbe-6137db245901-tls-certs\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891288 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tbs\" (UniqueName: \"kubernetes.io/projected/1d23cc7b-f7a8-4314-9dbe-6137db245901-kube-api-access-j8tbs\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891288 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-tmp-dir\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891288 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-dshm\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891288 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-model-cache\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891288 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-home\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891592 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891515    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-tmp-dir\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891642 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-home\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.891642 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.891598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-model-cache\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.893460 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.893439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-dshm\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.893727 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.893710    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d23cc7b-f7a8-4314-9dbe-6137db245901-tls-certs\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:07:59.902621 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:07:59.902595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tbs\" (UniqueName: \"kubernetes.io/projected/1d23cc7b-f7a8-4314-9dbe-6137db245901-kube-api-access-j8tbs\") pod \"auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") " pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:08:00.080586 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:00.080480    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:08:00.225183 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:00.225050    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"]
Jul 21 17:08:00.227788 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:08:00.227759    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d23cc7b_f7a8_4314_9dbe_6137db245901.slice/crio-5643c84d50c9c1b72e2f54ab5e6145ed8d8fe20a68b234f4905f75b0928151a2 WatchSource:0}: Error finding container 5643c84d50c9c1b72e2f54ab5e6145ed8d8fe20a68b234f4905f75b0928151a2: Status 404 returned error can't find the container with id 5643c84d50c9c1b72e2f54ab5e6145ed8d8fe20a68b234f4905f75b0928151a2
Jul 21 17:08:00.689204 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:00.689147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns" event={"ID":"1d23cc7b-f7a8-4314-9dbe-6137db245901","Type":"ContainerStarted","Data":"3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916"}
Jul 21 17:08:00.689204 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:00.689209    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns" event={"ID":"1d23cc7b-f7a8-4314-9dbe-6137db245901","Type":"ContainerStarted","Data":"5643c84d50c9c1b72e2f54ab5e6145ed8d8fe20a68b234f4905f75b0928151a2"}
Jul 21 17:08:00.713105 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:00.713048    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns" podStartSLOduration=1.713030085 podStartE2EDuration="1.713030085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:00.711328069 +0000 UTC m=+2402.979320744" watchObservedRunningTime="2026-07-21 17:08:00.713030085 +0000 UTC m=+2402.981022759"
Jul 21 17:08:04.078510 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:04.078476    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:08:10.080950 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:10.080907    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:08:10.080950 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:10.080957    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:08:10.093718 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:10.093688    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:08:10.754257 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:10.754221    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:08:12.995174 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:12.995143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:29.092148 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:29.092106    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:34.378348 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:34.378309    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:08:53.766803 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:08:53.766765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:09:09.420290 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:09:09.420253    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:09:29.392757 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:09:29.392724    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:09:33.763949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:09:33.763914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:46.382110 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:09:46.382072    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:10:00.468968 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:00.468886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:10:20.168921 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:20.168887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:10:24.487890 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:24.487858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:25.444688 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:25.444651    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"]
Jul 21 17:10:25.462963 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:25.462931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:30.951264 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.951235    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"]
Jul 21 17:10:30.953679 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.953662    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:30.957362 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.957337    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5b0b89\"/\"sub-test-model-5b0b89-kserve-self-signed-certs\""
Jul 21 17:10:30.957502 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.957362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5b0b89\"/\"kube-root-ca.crt\""
Jul 21 17:10:30.957502 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.957337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5b0b89\"/\"openshift-service-ca.crt\""
Jul 21 17:10:30.957502 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.957337    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5b0b89\"/\"default-dockercfg-q9b56\""
Jul 21 17:10:30.967450 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:30.967429    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"]
Jul 21 17:10:31.100519 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.100486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e56ed22-b29a-4e63-955b-6452a87f679f-tls-certs\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.100710 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.100530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-tmp-dir\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.100710 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.100558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-dshm\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.100710 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.100638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-model-cache\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.100710 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.100685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-home\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.100862 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.100715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nll\" (UniqueName: \"kubernetes.io/projected/2e56ed22-b29a-4e63-955b-6452a87f679f-kube-api-access-j4nll\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201504 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201419    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nll\" (UniqueName: \"kubernetes.io/projected/2e56ed22-b29a-4e63-955b-6452a87f679f-kube-api-access-j4nll\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201504 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e56ed22-b29a-4e63-955b-6452a87f679f-tls-certs\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201740 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-tmp-dir\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201740 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-dshm\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201740 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-model-cache\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201740 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-home\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.201966 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201937    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-tmp-dir\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.202049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.201994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-model-cache\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.202089 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.202055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-home\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.203961 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.203944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-dshm\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.204222 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.204198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e56ed22-b29a-4e63-955b-6452a87f679f-tls-certs\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.214048 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.214023    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nll\" (UniqueName: \"kubernetes.io/projected/2e56ed22-b29a-4e63-955b-6452a87f679f-kube-api-access-j4nll\") pod \"sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") " pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.262712 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.262678    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:31.362940 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.362894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:31.405723 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.405698    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"]
Jul 21 17:10:31.407409 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:10:31.407381    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e56ed22_b29a_4e63_955b_6452a87f679f.slice/crio-b43d32339089b84bcf85e0c126147fbdb39355df2411ec34eb6a35c14a0c06c6 WatchSource:0}: Error finding container b43d32339089b84bcf85e0c126147fbdb39355df2411ec34eb6a35c14a0c06c6: Status 404 returned error can't find the container with id b43d32339089b84bcf85e0c126147fbdb39355df2411ec34eb6a35c14a0c06c6
Jul 21 17:10:31.424772 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:31.424750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf" event={"ID":"2e56ed22-b29a-4e63-955b-6452a87f679f","Type":"ContainerStarted","Data":"b43d32339089b84bcf85e0c126147fbdb39355df2411ec34eb6a35c14a0c06c6"}
Jul 21 17:10:32.431055 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:32.431017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf" event={"ID":"2e56ed22-b29a-4e63-955b-6452a87f679f","Type":"ContainerStarted","Data":"71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45"}
Jul 21 17:10:32.450772 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:32.450720    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf" podStartSLOduration=2.450702299 podStartE2EDuration="2.450702299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:32.450023212 +0000 UTC m=+2554.718015887" watchObservedRunningTime="2026-07-21 17:10:32.450702299 +0000 UTC m=+2554.718694963"
Jul 21 17:10:37.758975 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:37.758937    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:10:40.467728 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.467657    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns" podUID="1d23cc7b-f7a8-4314-9dbe-6137db245901" containerName="main" containerID="cri-o://3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916" gracePeriod=45
Jul 21 17:10:40.719367 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.719313    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:10:40.883764 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.883732    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-dshm\") pod \"1d23cc7b-f7a8-4314-9dbe-6137db245901\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") "
Jul 21 17:10:40.883949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.883802    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-home\") pod \"1d23cc7b-f7a8-4314-9dbe-6137db245901\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") "
Jul 21 17:10:40.883949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.883840    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d23cc7b-f7a8-4314-9dbe-6137db245901-tls-certs\") pod \"1d23cc7b-f7a8-4314-9dbe-6137db245901\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") "
Jul 21 17:10:40.883949 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.883905    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8tbs\" (UniqueName: \"kubernetes.io/projected/1d23cc7b-f7a8-4314-9dbe-6137db245901-kube-api-access-j8tbs\") pod \"1d23cc7b-f7a8-4314-9dbe-6137db245901\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") "
Jul 21 17:10:40.884116 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.883960    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-model-cache\") pod \"1d23cc7b-f7a8-4314-9dbe-6137db245901\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") "
Jul 21 17:10:40.884116 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.883999    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-tmp-dir\") pod \"1d23cc7b-f7a8-4314-9dbe-6137db245901\" (UID: \"1d23cc7b-f7a8-4314-9dbe-6137db245901\") "
Jul 21 17:10:40.884116 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.884058    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-home" (OuterVolumeSpecName: "home") pod "1d23cc7b-f7a8-4314-9dbe-6137db245901" (UID: "1d23cc7b-f7a8-4314-9dbe-6137db245901"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:40.884321 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.884296    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d23cc7b-f7a8-4314-9dbe-6137db245901" (UID: "1d23cc7b-f7a8-4314-9dbe-6137db245901"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:40.884321 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.884311    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d23cc7b-f7a8-4314-9dbe-6137db245901" (UID: "1d23cc7b-f7a8-4314-9dbe-6137db245901"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:40.884636 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.884615    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-home\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:10:40.884677 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.884644    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-model-cache\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:10:40.884677 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.884661    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-tmp-dir\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:10:40.886204 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.886154    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d23cc7b-f7a8-4314-9dbe-6137db245901-kube-api-access-j8tbs" (OuterVolumeSpecName: "kube-api-access-j8tbs") pod "1d23cc7b-f7a8-4314-9dbe-6137db245901" (UID: "1d23cc7b-f7a8-4314-9dbe-6137db245901"). InnerVolumeSpecName "kube-api-access-j8tbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:10:40.886204 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.886194    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d23cc7b-f7a8-4314-9dbe-6137db245901-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d23cc7b-f7a8-4314-9dbe-6137db245901" (UID: "1d23cc7b-f7a8-4314-9dbe-6137db245901"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:10:40.886348 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.886182    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-dshm" (OuterVolumeSpecName: "dshm") pod "1d23cc7b-f7a8-4314-9dbe-6137db245901" (UID: "1d23cc7b-f7a8-4314-9dbe-6137db245901"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:10:40.986193 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.986087    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d23cc7b-f7a8-4314-9dbe-6137db245901-tls-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:10:40.986193 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.986117    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8tbs\" (UniqueName: \"kubernetes.io/projected/1d23cc7b-f7a8-4314-9dbe-6137db245901-kube-api-access-j8tbs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:10:40.986193 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:40.986130    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d23cc7b-f7a8-4314-9dbe-6137db245901-dshm\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:10:41.263756 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.263725    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:41.263933 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.263807    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:41.276038 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.276017    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:41.473587 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.473555    2575 generic.go:356] "Generic (PLEG): container finished" podID="1d23cc7b-f7a8-4314-9dbe-6137db245901" containerID="3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916" exitCode=0
Jul 21 17:10:41.474046 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.473602    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"
Jul 21 17:10:41.474046 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.473639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns" event={"ID":"1d23cc7b-f7a8-4314-9dbe-6137db245901","Type":"ContainerDied","Data":"3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916"}
Jul 21 17:10:41.474046 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.473695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns" event={"ID":"1d23cc7b-f7a8-4314-9dbe-6137db245901","Type":"ContainerDied","Data":"5643c84d50c9c1b72e2f54ab5e6145ed8d8fe20a68b234f4905f75b0928151a2"}
Jul 21 17:10:41.474046 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.473713    2575 scope.go:117] "RemoveContainer" containerID="3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916"
Jul 21 17:10:41.483049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.483030    2575 scope.go:117] "RemoveContainer" containerID="3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916"
Jul 21 17:10:41.483378 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:10:41.483350    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916\": container with ID starting with 3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916 not found: ID does not exist" containerID="3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916"
Jul 21 17:10:41.483470 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.483385    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916"} err="failed to get container status \"3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916\": rpc error: code = NotFound desc = could not find container \"3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916\": container with ID starting with 3efe0d0dc1a1e0de59c081ca916d0cf8b37213d9b7950544e5a284958a790916 not found: ID does not exist"
Jul 21 17:10:41.488661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.488643    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:10:41.497300 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.497279    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"]
Jul 21 17:10:41.501893 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:41.501871    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/auth-test-model-e17cb5-kserve-cbb6fd547-4s9ns"]
Jul 21 17:10:42.245622 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:10:42.245586    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d23cc7b-f7a8-4314-9dbe-6137db245901" path="/var/lib/kubelet/pods/1d23cc7b-f7a8-4314-9dbe-6137db245901/volumes"
Jul 21 17:11:17.150371 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:11:17.150311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:20.773517 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:11:20.773433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:11:47.670650 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:11:47.670607    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:11:55.624062 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:11:55.624025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:55.727371 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:11:55.727342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:04.257744 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:04.257710    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"]
Jul 21 17:12:04.275146 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:04.275118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:06.477249 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:06.477196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:10.569457 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:10.569411    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:12:17.893404 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:17.893368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:19.278567 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.278501    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf" podUID="2e56ed22-b29a-4e63-955b-6452a87f679f" containerName="main" containerID="cri-o://71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45" gracePeriod=45
Jul 21 17:12:19.537034 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.536965    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:12:19.615851 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.615820    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4nll\" (UniqueName: \"kubernetes.io/projected/2e56ed22-b29a-4e63-955b-6452a87f679f-kube-api-access-j4nll\") pod \"2e56ed22-b29a-4e63-955b-6452a87f679f\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") "
Jul 21 17:12:19.615851 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.615857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-home\") pod \"2e56ed22-b29a-4e63-955b-6452a87f679f\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") "
Jul 21 17:12:19.616109 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.615914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-tmp-dir\") pod \"2e56ed22-b29a-4e63-955b-6452a87f679f\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") "
Jul 21 17:12:19.616109 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616081    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e56ed22-b29a-4e63-955b-6452a87f679f-tls-certs\") pod \"2e56ed22-b29a-4e63-955b-6452a87f679f\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") "
Jul 21 17:12:19.616251 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616121    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-model-cache\") pod \"2e56ed22-b29a-4e63-955b-6452a87f679f\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") "
Jul 21 17:12:19.616251 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616158    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-home" (OuterVolumeSpecName: "home") pod "2e56ed22-b29a-4e63-955b-6452a87f679f" (UID: "2e56ed22-b29a-4e63-955b-6452a87f679f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:19.616251 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-dshm\") pod \"2e56ed22-b29a-4e63-955b-6452a87f679f\" (UID: \"2e56ed22-b29a-4e63-955b-6452a87f679f\") "
Jul 21 17:12:19.616251 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e56ed22-b29a-4e63-955b-6452a87f679f" (UID: "2e56ed22-b29a-4e63-955b-6452a87f679f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:19.616454 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616397    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e56ed22-b29a-4e63-955b-6452a87f679f" (UID: "2e56ed22-b29a-4e63-955b-6452a87f679f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:19.616454 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616445    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-home\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:12:19.616531 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.616466    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-tmp-dir\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:12:19.618400 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.618375    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e56ed22-b29a-4e63-955b-6452a87f679f-kube-api-access-j4nll" (OuterVolumeSpecName: "kube-api-access-j4nll") pod "2e56ed22-b29a-4e63-955b-6452a87f679f" (UID: "2e56ed22-b29a-4e63-955b-6452a87f679f"). InnerVolumeSpecName "kube-api-access-j4nll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:12:19.618400 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.618386    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e56ed22-b29a-4e63-955b-6452a87f679f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e56ed22-b29a-4e63-955b-6452a87f679f" (UID: "2e56ed22-b29a-4e63-955b-6452a87f679f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:12:19.618577 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.618368    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-dshm" (OuterVolumeSpecName: "dshm") pod "2e56ed22-b29a-4e63-955b-6452a87f679f" (UID: "2e56ed22-b29a-4e63-955b-6452a87f679f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:12:19.717848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.717814    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4nll\" (UniqueName: \"kubernetes.io/projected/2e56ed22-b29a-4e63-955b-6452a87f679f-kube-api-access-j4nll\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:12:19.717848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.717842    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e56ed22-b29a-4e63-955b-6452a87f679f-tls-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:12:19.717848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.717852    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-model-cache\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:12:19.718077 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.717859    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e56ed22-b29a-4e63-955b-6452a87f679f-dshm\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:12:19.965073 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.964981    2575 generic.go:356] "Generic (PLEG): container finished" podID="2e56ed22-b29a-4e63-955b-6452a87f679f" containerID="71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45" exitCode=0
Jul 21 17:12:19.965073 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.965029    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"
Jul 21 17:12:19.965073 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.965060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf" event={"ID":"2e56ed22-b29a-4e63-955b-6452a87f679f","Type":"ContainerDied","Data":"71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45"}
Jul 21 17:12:19.965308 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.965105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf" event={"ID":"2e56ed22-b29a-4e63-955b-6452a87f679f","Type":"ContainerDied","Data":"b43d32339089b84bcf85e0c126147fbdb39355df2411ec34eb6a35c14a0c06c6"}
Jul 21 17:12:19.965308 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.965122    2575 scope.go:117] "RemoveContainer" containerID="71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45"
Jul 21 17:12:19.978113 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.978092    2575 scope.go:117] "RemoveContainer" containerID="71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45"
Jul 21 17:12:19.978454 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:12:19.978433    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45\": container with ID starting with 71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45 not found: ID does not exist" containerID="71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45"
Jul 21 17:12:19.978537 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.978462    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45"} err="failed to get container status \"71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45\": rpc error: code = NotFound desc = could not find container \"71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45\": container with ID starting with 71185610b34fd2072d598ca9370fd72cee0b5e9b24c696c65ea7138fc98b9a45 not found: ID does not exist"
Jul 21 17:12:19.991297 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.991271    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"]
Jul 21 17:12:19.997183 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:19.997138    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5b0b89/sub-test-model-5b0b89-kserve-6c9b868c5f-xkcrf"]
Jul 21 17:12:20.244885 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:20.244861    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e56ed22-b29a-4e63-955b-6452a87f679f" path="/var/lib/kubelet/pods/2e56ed22-b29a-4e63-955b-6452a87f679f/volumes"
Jul 21 17:12:23.969787 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:23.969751    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:12:42.749291 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:42.749258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:42.918732 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:42.918606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:51.826783 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:51.826683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:51.920773 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:51.920731    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:58.388368 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:58.388331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:12:58.394423 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:12:58.394393    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:13:05.579884 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.579847    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"]
Jul 21 17:13:05.580294 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.580253    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d23cc7b-f7a8-4314-9dbe-6137db245901" containerName="main"
Jul 21 17:13:05.580294 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.580267    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d23cc7b-f7a8-4314-9dbe-6137db245901" containerName="main"
Jul 21 17:13:05.580294 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.580274    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e56ed22-b29a-4e63-955b-6452a87f679f" containerName="main"
Jul 21 17:13:05.580294 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.580280    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e56ed22-b29a-4e63-955b-6452a87f679f" containerName="main"
Jul 21 17:13:05.580431 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.580348    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e56ed22-b29a-4e63-955b-6452a87f679f" containerName="main"
Jul 21 17:13:05.580431 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.580358    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d23cc7b-f7a8-4314-9dbe-6137db245901" containerName="main"
Jul 21 17:13:05.582400 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.582376    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.585349 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.585322    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"default-dockercfg-jhbxf\""
Jul 21 17:13:05.585497 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.585326    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"openshift-service-ca.crt\""
Jul 21 17:13:05.586986 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.586962    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"kube-root-ca.crt\""
Jul 21 17:13:05.587125 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.586963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e17cb5\"/\"rate-test-model-e17cb5-kserve-self-signed-certs\""
Jul 21 17:13:05.595996 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.595967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"]
Jul 21 17:13:05.619522 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.619481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:05.644933 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.644893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwchd\" (UniqueName: \"kubernetes.io/projected/0f3ba125-74c1-4642-971b-2ba264cc024b-kube-api-access-nwchd\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.645186 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.644986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-dshm\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.645186 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.645087    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-model-cache\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.645186 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.645121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f3ba125-74c1-4642-971b-2ba264cc024b-tls-certs\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.645387 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.645231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-tmp-dir\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.645387 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.645329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-home\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.745992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.745945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-home\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746231 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwchd\" (UniqueName: \"kubernetes.io/projected/0f3ba125-74c1-4642-971b-2ba264cc024b-kube-api-access-nwchd\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746231 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-dshm\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746231 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-model-cache\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746231 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f3ba125-74c1-4642-971b-2ba264cc024b-tls-certs\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746231 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-tmp-dir\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746488 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-home\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746567 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-model-cache\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.746567 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.746548    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-tmp-dir\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.748753 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.748726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-dshm\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.748900 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.748886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f3ba125-74c1-4642-971b-2ba264cc024b-tls-certs\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.755702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.755673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwchd\" (UniqueName: \"kubernetes.io/projected/0f3ba125-74c1-4642-971b-2ba264cc024b-kube-api-access-nwchd\") pod \"rate-test-model-e17cb5-kserve-6b496d8875-zvtnx\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") " pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:05.892981 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:05.892877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:06.057407 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:06.057376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"]
Jul 21 17:13:06.193498 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:06.193391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx" event={"ID":"0f3ba125-74c1-4642-971b-2ba264cc024b","Type":"ContainerStarted","Data":"6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9"}
Jul 21 17:13:06.193498 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:06.193444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx" event={"ID":"0f3ba125-74c1-4642-971b-2ba264cc024b","Type":"ContainerStarted","Data":"a8810e58b1dfe34083df69b6117a2cb46ebfe447fe329a34636cc0dc07565f55"}
Jul 21 17:13:06.211604 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:06.211550    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx" podStartSLOduration=1.211533237 podStartE2EDuration="1.211533237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:13:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:13:06.210835443 +0000 UTC m=+2708.478828148" watchObservedRunningTime="2026-07-21 17:13:06.211533237 +0000 UTC m=+2708.479525981"
Jul 21 17:13:09.094113 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:09.094073    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:13:15.893236 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:15.893194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:15.893855 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:15.893255    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:15.905654 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:15.905629    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:16.253303 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:16.253275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:13:23.478974 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:23.478934    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:13:38.782963 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:38.782924    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:13:46.020638 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:46.020597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:46.877399 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:46.877371    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"]
Jul 21 17:13:46.905180 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:46.905136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:13:53.376768 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:13:53.376728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:14:01.897425 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:01.897378    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx" podUID="0f3ba125-74c1-4642-971b-2ba264cc024b" containerName="main" containerID="cri-o://6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9" gracePeriod=45
Jul 21 17:14:02.151714 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.151652    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:14:02.259973 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.259948    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwchd\" (UniqueName: \"kubernetes.io/projected/0f3ba125-74c1-4642-971b-2ba264cc024b-kube-api-access-nwchd\") pod \"0f3ba125-74c1-4642-971b-2ba264cc024b\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") "
Jul 21 17:14:02.260157 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260034    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-model-cache\") pod \"0f3ba125-74c1-4642-971b-2ba264cc024b\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") "
Jul 21 17:14:02.260157 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260081    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-home\") pod \"0f3ba125-74c1-4642-971b-2ba264cc024b\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") "
Jul 21 17:14:02.260157 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260101    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-tmp-dir\") pod \"0f3ba125-74c1-4642-971b-2ba264cc024b\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") "
Jul 21 17:14:02.260157 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260127    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f3ba125-74c1-4642-971b-2ba264cc024b-tls-certs\") pod \"0f3ba125-74c1-4642-971b-2ba264cc024b\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") "
Jul 21 17:14:02.260157 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260158    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-dshm\") pod \"0f3ba125-74c1-4642-971b-2ba264cc024b\" (UID: \"0f3ba125-74c1-4642-971b-2ba264cc024b\") "
Jul 21 17:14:02.260452 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260356    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f3ba125-74c1-4642-971b-2ba264cc024b" (UID: "0f3ba125-74c1-4642-971b-2ba264cc024b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:02.260452 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260369    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-home" (OuterVolumeSpecName: "home") pod "0f3ba125-74c1-4642-971b-2ba264cc024b" (UID: "0f3ba125-74c1-4642-971b-2ba264cc024b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:02.260452 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.260387    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f3ba125-74c1-4642-971b-2ba264cc024b" (UID: "0f3ba125-74c1-4642-971b-2ba264cc024b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:02.262314 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.262288    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-dshm" (OuterVolumeSpecName: "dshm") pod "0f3ba125-74c1-4642-971b-2ba264cc024b" (UID: "0f3ba125-74c1-4642-971b-2ba264cc024b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:02.262421 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.262338    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f3ba125-74c1-4642-971b-2ba264cc024b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f3ba125-74c1-4642-971b-2ba264cc024b" (UID: "0f3ba125-74c1-4642-971b-2ba264cc024b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:14:02.262421 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.262381    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f3ba125-74c1-4642-971b-2ba264cc024b-kube-api-access-nwchd" (OuterVolumeSpecName: "kube-api-access-nwchd") pod "0f3ba125-74c1-4642-971b-2ba264cc024b" (UID: "0f3ba125-74c1-4642-971b-2ba264cc024b"). InnerVolumeSpecName "kube-api-access-nwchd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:02.361185 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.361125    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-model-cache\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:02.361185 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.361155    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-home\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:02.361185 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.361183    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-tmp-dir\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:02.361185 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.361191    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f3ba125-74c1-4642-971b-2ba264cc024b-tls-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:02.361531 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.361269    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f3ba125-74c1-4642-971b-2ba264cc024b-dshm\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:02.361531 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.361277    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwchd\" (UniqueName: \"kubernetes.io/projected/0f3ba125-74c1-4642-971b-2ba264cc024b-kube-api-access-nwchd\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:02.471134 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.471044    2575 generic.go:356] "Generic (PLEG): container finished" podID="0f3ba125-74c1-4642-971b-2ba264cc024b" containerID="6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9" exitCode=0
Jul 21 17:14:02.471134 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.471088    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"
Jul 21 17:14:02.471134 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.471126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx" event={"ID":"0f3ba125-74c1-4642-971b-2ba264cc024b","Type":"ContainerDied","Data":"6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9"}
Jul 21 17:14:02.471387 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.471191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx" event={"ID":"0f3ba125-74c1-4642-971b-2ba264cc024b","Type":"ContainerDied","Data":"a8810e58b1dfe34083df69b6117a2cb46ebfe447fe329a34636cc0dc07565f55"}
Jul 21 17:14:02.471387 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.471216    2575 scope.go:117] "RemoveContainer" containerID="6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9"
Jul 21 17:14:02.487882 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.487852    2575 scope.go:117] "RemoveContainer" containerID="6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9"
Jul 21 17:14:02.488408 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:14:02.488378    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9\": container with ID starting with 6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9 not found: ID does not exist" containerID="6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9"
Jul 21 17:14:02.488513 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.488411    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9"} err="failed to get container status \"6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9\": rpc error: code = NotFound desc = could not find container \"6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9\": container with ID starting with 6bc33d0d294fc43cf2a7c1fd327a1190224ced98b699d024584f3eaf8fdb63c9 not found: ID does not exist"
Jul 21 17:14:02.499513 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.499474    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"]
Jul 21 17:14:02.504372 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:02.504345    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e17cb5/rate-test-model-e17cb5-kserve-6b496d8875-zvtnx"]
Jul 21 17:14:04.244891 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:04.244856    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f3ba125-74c1-4642-971b-2ba264cc024b" path="/var/lib/kubelet/pods/0f3ba125-74c1-4642-971b-2ba264cc024b/volumes"
Jul 21 17:14:06.774918 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:06.774885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:06.876108 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:06.876077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:16.865280 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:16.865210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:19.967947 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:19.967863    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:14:21.330892 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:21.330854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:21.696111 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:21.696027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:21.797927 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:21.797889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:27.894354 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:27.894319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:27.995016 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:27.994983    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:28.122013 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:28.121975    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"]
Jul 21 17:14:28.122292 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:28.122234    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy" containerID="cri-o://a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696" gracePeriod=30
Jul 21 17:14:28.147669 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:28.147589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:28.382369 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:28.382336    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:29.111355 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:29.111306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:29.209973 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:29.209929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:33.373890 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.373857    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:14:33.449049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.448959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-token\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449006    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-certs\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449026    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-podinfo\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449041    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvqm7\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-kube-api-access-kvqm7\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449418 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449067    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-data\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449418 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449097    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-socket\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449418 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istiod-ca-cert\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449418 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449143    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-envoy\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449418 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449219    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-credential-socket\") pod \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\" (UID: \"f9e8a1e3-85aa-4da0-9490-a991071aefe0\") "
Jul 21 17:14:33.449687 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449569    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:14:33.449825 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449738    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:33.449994 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449896    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:33.449994 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.449904    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:33.450427 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.450392    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:33.451480 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.451458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:33.451480 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.451473    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:14:33.452016 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.451996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:33.452075 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.452008    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-kube-api-access-kvqm7" (OuterVolumeSpecName: "kube-api-access-kvqm7") pod "f9e8a1e3-85aa-4da0-9490-a991071aefe0" (UID: "f9e8a1e3-85aa-4da0-9490-a991071aefe0"). InnerVolumeSpecName "kube-api-access-kvqm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:33.550241 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550210    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550241 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550239    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550251    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550264    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvqm7\" (UniqueName: \"kubernetes.io/projected/f9e8a1e3-85aa-4da0-9490-a991071aefe0-kube-api-access-kvqm7\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550276    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550287    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550296    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550307    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.550451 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.550317    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8a1e3-85aa-4da0-9490-a991071aefe0-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:33.624838 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.624802    2575 generic.go:356] "Generic (PLEG): container finished" podID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerID="a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696" exitCode=0
Jul 21 17:14:33.625024 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.624860    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"
Jul 21 17:14:33.625024 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.624887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" event={"ID":"f9e8a1e3-85aa-4da0-9490-a991071aefe0","Type":"ContainerDied","Data":"a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696"}
Jul 21 17:14:33.625024 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.624940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8" event={"ID":"f9e8a1e3-85aa-4da0-9490-a991071aefe0","Type":"ContainerDied","Data":"d1979bde043f8a3029bbd1daa3376a241a1fa562b77fef4f94ff04606f2e9266"}
Jul 21 17:14:33.625024 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.624964    2575 scope.go:117] "RemoveContainer" containerID="a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696"
Jul 21 17:14:33.634252 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.634233    2575 scope.go:117] "RemoveContainer" containerID="14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"
Jul 21 17:14:33.642379 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.642361    2575 scope.go:117] "RemoveContainer" containerID="a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696"
Jul 21 17:14:33.642638 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:14:33.642616    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696\": container with ID starting with a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696 not found: ID does not exist" containerID="a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696"
Jul 21 17:14:33.642702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.642646    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696"} err="failed to get container status \"a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696\": rpc error: code = NotFound desc = could not find container \"a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696\": container with ID starting with a03f4c544c401a033e20b1dce767c55784a1698bfea053fc4acad0ca72af4696 not found: ID does not exist"
Jul 21 17:14:33.642702 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.642663    2575 scope.go:117] "RemoveContainer" containerID="14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"
Jul 21 17:14:33.642910 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:14:33.642894    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46\": container with ID starting with 14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46 not found: ID does not exist" containerID="14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"
Jul 21 17:14:33.642960 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.642914    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46"} err="failed to get container status \"14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46\": rpc error: code = NotFound desc = could not find container \"14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46\": container with ID starting with 14fb8ab7377d039a839e28d177cc07e04ad7a921b78917a6ec8a7f6f4854eb46 not found: ID does not exist"
Jul 21 17:14:33.650006 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.649980    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"]
Jul 21 17:14:33.656972 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:33.656952    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5b0b89-openshift-default-5dc59c6d79-24rp8"]
Jul 21 17:14:34.245008 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:34.244975    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" path="/var/lib/kubelet/pods/f9e8a1e3-85aa-4da0-9490-a991071aefe0/volumes"
Jul 21 17:14:39.067541 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:39.067503    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:39.779691 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:39.779630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:39.842332 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:39.842302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:41.864421 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:41.864384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mt2sb"]
Jul 21 17:14:43.582427 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:43.582395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:43.941503 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:43.941424    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:46.013560 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:46.013528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:46.066886 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:46.066854    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:50.504995 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:50.504958    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:50.582382 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:50.582351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:50.779103 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:50.779018    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"]
Jul 21 17:14:50.779390 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:50.779332    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy" containerID="cri-o://5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e" gracePeriod=30
Jul 21 17:14:50.795578 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:50.795551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:51.074475 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:51.074384    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:14:56.042661 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.042601    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:14:56.153948 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.153909    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-credential-socket\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.153948 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.153952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzrqr\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-kube-api-access-vzrqr\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.153976    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-podinfo\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.153996    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-socket\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154017    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-token\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-data\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154104    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istiod-ca-cert\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154137    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-certs\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154229 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154208    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-envoy\") pod \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\" (UID: \"504159c1-2b3b-4831-a1f8-1ff9d24d16cc\") "
Jul 21 17:14:56.154576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154242    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:56.154576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154412    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:56.154576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154467    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:56.154576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154520    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:14:56.154576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154533    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-credential-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.154576 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.154568    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-socket\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.155478 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.155449    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:56.156410 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.156385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 17:14:56.156793 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.156404    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-kube-api-access-vzrqr" (OuterVolumeSpecName: "kube-api-access-vzrqr") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "kube-api-access-vzrqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:56.157075 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.157054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:56.157075 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.157058    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "504159c1-2b3b-4831-a1f8-1ff9d24d16cc" (UID: "504159c1-2b3b-4831-a1f8-1ff9d24d16cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:14:56.255764 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255743    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-data\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.255764 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255765    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istiod-ca-cert\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.255879 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255773    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-workload-certs\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.255879 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255780    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-envoy\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.255879 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255787    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzrqr\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-kube-api-access-vzrqr\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.255879 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255795    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-podinfo\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.255879 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.255802    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504159c1-2b3b-4831-a1f8-1ff9d24d16cc-istio-token\") on node \"ip-10-0-129-98.ec2.internal\" DevicePath \"\""
Jul 21 17:14:56.743144 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.743104    2575 generic.go:356] "Generic (PLEG): container finished" podID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerID="5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e" exitCode=0
Jul 21 17:14:56.743353 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.743194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"
Jul 21 17:14:56.743353 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.743192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" event={"ID":"504159c1-2b3b-4831-a1f8-1ff9d24d16cc","Type":"ContainerDied","Data":"5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e"}
Jul 21 17:14:56.743353 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.743254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q" event={"ID":"504159c1-2b3b-4831-a1f8-1ff9d24d16cc","Type":"ContainerDied","Data":"63de131f71488d281ed744b45880cd3c9b63e3cf134d34e7e2220466ab67ce7d"}
Jul 21 17:14:56.743353 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.743276    2575 scope.go:117] "RemoveContainer" containerID="5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e"
Jul 21 17:14:56.752210 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.752196    2575 scope.go:117] "RemoveContainer" containerID="ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"
Jul 21 17:14:56.760049 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.760033    2575 scope.go:117] "RemoveContainer" containerID="5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e"
Jul 21 17:14:56.760323 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:14:56.760304    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e\": container with ID starting with 5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e not found: ID does not exist" containerID="5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e"
Jul 21 17:14:56.760398 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.760338    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e"} err="failed to get container status \"5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e\": rpc error: code = NotFound desc = could not find container \"5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e\": container with ID starting with 5fe2ed426985377d3426e6d6c41cb71cd7052def5edde14eab3105bfe4a1bc3e not found: ID does not exist"
Jul 21 17:14:56.760398 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.760363    2575 scope.go:117] "RemoveContainer" containerID="ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"
Jul 21 17:14:56.760627 ip-10-0-129-98 kubenswrapper[2575]: E0721 17:14:56.760610    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464\": container with ID starting with ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464 not found: ID does not exist" containerID="ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"
Jul 21 17:14:56.760675 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.760635    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464"} err="failed to get container status \"ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464\": rpc error: code = NotFound desc = could not find container \"ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464\": container with ID starting with ce755efe848e18f4dfb8692b8e7f8bf352f84ce85318fc80b020f5d61d961464 not found: ID does not exist"
Jul 21 17:14:56.764713 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.764690    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"]
Jul 21 17:14:56.770426 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.770403    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e17cb5-openshift-default-767d886cc9-n4n8q"]
Jul 21 17:14:56.924796 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:56.924770    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57669fdb4c-bjmj8_8322f46a-57fb-47c3-96de-26b2e442fd60/manager/0.log"
Jul 21 17:14:57.396204 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:57.396146    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-hvm4c_84d05eaf-8f43-4b3a-965f-f86c49a2664e/manager/0.log"
Jul 21 17:14:57.403422 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:57.403399    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-hvm4c_84d05eaf-8f43-4b3a-965f-f86c49a2664e/copy-manifests/0.log"
Jul 21 17:14:57.841025 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:57.840998    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-844568fb96-9n4cq_4a8b5a8e-68ef-4d76-9554-6baae9076d23/maas-api/0.log"
Jul 21 17:14:58.245286 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:14:58.245259    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" path="/var/lib/kubelet/pods/504159c1-2b3b-4831-a1f8-1ff9d24d16cc/volumes"
Jul 21 17:15:00.059372 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:00.059343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mt2sb_94b36d0d-b5d2-4ee1-bd7d-a785146a3aad/limitador/0.log"
Jul 21 17:15:00.178203 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:00.178154    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x7w2k_5a408025-c5e9-48aa-aa2d-6698243523f2/manager/0.log"
Jul 21 17:15:01.065802 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:01.065768    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vm87z_a686eb97-0c87-4c68-909b-9d964380ce4e/payload-pre-processing/0.log"
Jul 21 17:15:01.294419 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:01.294379    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58b59cb77b-zj22b_ff6d6bd9-9abb-4693-a65f-0cc455f79821/router/0.log"
Jul 21 17:15:01.982846 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:01.982818    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpqc4h_bf476e2e-dec3-4ecf-bcbb-ea4fff3100fd/main/0.log"
Jul 21 17:15:02.214697 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:02.214634    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-m8677_6b7deb25-b2a6-4595-9598-ccea7d80ce03/main/0.log"
Jul 21 17:15:07.191560 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:07.191517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:07.261783 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:07.261752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:10.380070 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:10.380039    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5vdds_52c5b102-a3da-43a7-867e-d143f298e61b/global-pull-secret-syncer/0.log"
Jul 21 17:15:10.467220 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:10.467190    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log"
Jul 21 17:15:10.561699 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:10.561665    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-98.ec2.internal_a1e91e225a0145e17a81d6cda6c1fe8a/haproxy/0.log"
Jul 21 17:15:16.056140 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:16.056106    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mt2sb_94b36d0d-b5d2-4ee1-bd7d-a785146a3aad/limitador/0.log"
Jul 21 17:15:16.123534 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:16.123498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x7w2k_5a408025-c5e9-48aa-aa2d-6698243523f2/manager/0.log"
Jul 21 17:15:17.997889 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:17.997859    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-v8q69_819d4b8d-220e-4731-a09f-8138b4ac316c/cluster-monitoring-operator/0.log"
Jul 21 17:15:18.205719 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:18.205696    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vqmf_bb57f28a-0861-4e86-9338-625de1fa821f/node-exporter/0.log"
Jul 21 17:15:18.228913 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:18.228892    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vqmf_bb57f28a-0861-4e86-9338-625de1fa821f/kube-rbac-proxy/0.log"
Jul 21 17:15:18.251134 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:18.251062    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vqmf_bb57f28a-0861-4e86-9338-625de1fa821f/init-textfile/0.log"
Jul 21 17:15:20.207510 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.207478    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-vqn6q_92f64932-2fc7-4438-bc0e-6b8858c142c5/networking-console-plugin/0.log"
Jul 21 17:15:20.843945 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.843914    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/1.log"
Jul 21 17:15:20.848017 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.847999    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2zslp_ad8a4f0f-06a0-454d-9fbe-bb1373a383e0/console-operator/2.log"
Jul 21 17:15:20.886245 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886220    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"]
Jul 21 17:15:20.886582 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886570    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy"
Jul 21 17:15:20.886633 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886583    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy"
Jul 21 17:15:20.886633 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886596    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f3ba125-74c1-4642-971b-2ba264cc024b" containerName="main"
Jul 21 17:15:20.886633 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886602    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f3ba125-74c1-4642-971b-2ba264cc024b" containerName="main"
Jul 21 17:15:20.886633 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886621    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy"
Jul 21 17:15:20.886633 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886629    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886647    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886655    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886714    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886721    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="504159c1-2b3b-4831-a1f8-1ff9d24d16cc" containerName="istio-proxy"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886727    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886733    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f3ba125-74c1-4642-971b-2ba264cc024b" containerName="main"
Jul 21 17:15:20.886865 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.886738    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e8a1e3-85aa-4da0-9490-a991071aefe0" containerName="istio-proxy"
Jul 21 17:15:20.889798 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.889781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:20.892747 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.892723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbkhg\"/\"kube-root-ca.crt\""
Jul 21 17:15:20.892848 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.892723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbkhg\"/\"openshift-service-ca.crt\""
Jul 21 17:15:20.893466 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.893453    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbkhg\"/\"default-dockercfg-mwnqs\""
Jul 21 17:15:20.902088 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.902066    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"]
Jul 21 17:15:20.978300 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.978267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-lib-modules\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:20.978300 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.978302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wknzv\" (UniqueName: \"kubernetes.io/projected/4f42381c-b552-4603-81c7-55e8345065bc-kube-api-access-wknzv\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:20.978529 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.978349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-podres\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:20.978529 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.978383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-sys\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:20.978529 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:20.978409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-proc\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079026 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.078990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-lib-modules\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079026 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wknzv\" (UniqueName: \"kubernetes.io/projected/4f42381c-b552-4603-81c7-55e8345065bc-kube-api-access-wknzv\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079273 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-podres\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079273 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-podres\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079273 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-sys\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079273 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079191    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-lib-modules\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079273 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-proc\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079273 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-sys\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.079463 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.079288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f42381c-b552-4603-81c7-55e8345065bc-proc\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.090425 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.090400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wknzv\" (UniqueName: \"kubernetes.io/projected/4f42381c-b552-4603-81c7-55e8345065bc-kube-api-access-wknzv\") pod \"perf-node-gather-daemonset-qdqjv\" (UID: \"4f42381c-b552-4603-81c7-55e8345065bc\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.199481 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.199410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.332119 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.332086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"]
Jul 21 17:15:21.333912 ip-10-0-129-98 kubenswrapper[2575]: W0721 17:15:21.333870    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f42381c_b552_4603_81c7_55e8345065bc.slice/crio-11b3fe375f37c74f01a317e0ca05bbed4c3821bba833fbc4727a6f4cec8d3640 WatchSource:0}: Error finding container 11b3fe375f37c74f01a317e0ca05bbed4c3821bba833fbc4727a6f4cec8d3640: Status 404 returned error can't find the container with id 11b3fe375f37c74f01a317e0ca05bbed4c3821bba833fbc4727a6f4cec8d3640
Jul 21 17:15:21.512434 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.512410    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-sp8dt_bdb711dc-4ac5-4907-ac2c-3d4fb174dfb6/download-server/0.log"
Jul 21 17:15:21.862946 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.862854    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv" event={"ID":"4f42381c-b552-4603-81c7-55e8345065bc","Type":"ContainerStarted","Data":"a89d198585c4b61da801491f2d54e8994b88fef8642df10f4f9346bc6624cdf0"}
Jul 21 17:15:21.862946 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.862909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv" event={"ID":"4f42381c-b552-4603-81c7-55e8345065bc","Type":"ContainerStarted","Data":"11b3fe375f37c74f01a317e0ca05bbed4c3821bba833fbc4727a6f4cec8d3640"}
Jul 21 17:15:21.862946 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.862940    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:21.882249 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:21.882202    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv" podStartSLOduration=1.8821880050000002 podStartE2EDuration="1.882188005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:21.880897324 +0000 UTC m=+2844.148890013" watchObservedRunningTime="2026-07-21 17:15:21.882188005 +0000 UTC m=+2844.150180700"
Jul 21 17:15:22.093546 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:22.093518    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-gbgp5_28041f07-ca0f-4805-96c1-c23863f574a8/volume-data-source-validator/0.log"
Jul 21 17:15:23.149841 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:23.149812    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ps9h7_ca29479a-4684-44ed-ab84-e83bb8676bab/dns/0.log"
Jul 21 17:15:23.170160 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:23.170137    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ps9h7_ca29479a-4684-44ed-ab84-e83bb8676bab/kube-rbac-proxy/0.log"
Jul 21 17:15:23.236335 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:23.236307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7t5gx_82fd1bab-16d3-4a93-b99d-6cd2c790ce4c/dns-node-resolver/0.log"
Jul 21 17:15:23.845145 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:23.845119    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6nn9_4d5760a6-59bf-4b99-bf09-c3834f29411c/node-ca/0.log"
Jul 21 17:15:25.164033 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:25.164002    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vm87z_a686eb97-0c87-4c68-909b-9d964380ce4e/payload-pre-processing/0.log"
Jul 21 17:15:25.215292 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:25.215265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58b59cb77b-zj22b_ff6d6bd9-9abb-4693-a65f-0cc455f79821/router/0.log"
Jul 21 17:15:25.926311 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:25.926276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4kgw6_4aab204f-103a-4267-94af-f175c1cbc0df/serve-healthcheck-canary/0.log"
Jul 21 17:15:26.450992 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:26.450959    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-n7j2x_01e09e9b-370f-4ad3-8865-745845519116/insights-operator/0.log"
Jul 21 17:15:26.451698 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:26.451682    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-n7j2x_01e09e9b-370f-4ad3-8865-745845519116/insights-operator/1.log"
Jul 21 17:15:26.625701 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:26.625671    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p6clr_81934a32-6460-4a08-b572-9b0602ebb0f4/kube-rbac-proxy/0.log"
Jul 21 17:15:26.649177 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:26.649152    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p6clr_81934a32-6460-4a08-b572-9b0602ebb0f4/exporter/0.log"
Jul 21 17:15:26.670824 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:26.670800    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p6clr_81934a32-6460-4a08-b572-9b0602ebb0f4/extractor/0.log"
Jul 21 17:15:27.878219 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:27.878186    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-qdqjv"
Jul 21 17:15:28.845133 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:28.845100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9m6mx_9caf168e-ecbf-41a3-a16e-eefd37999650/konnectivity-agent/0.log" limit=1024
Jul 21 17:15:29.167829 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:29.167716    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57669fdb4c-bjmj8_8322f46a-57fb-47c3-96de-26b2e442fd60/manager/0.log"
Jul 21 17:15:29.378336 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:29.378300    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-hvm4c_84d05eaf-8f43-4b3a-965f-f86c49a2664e/manager/0.log"
Jul 21 17:15:29.397068 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:29.397047    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-hvm4c_84d05eaf-8f43-4b3a-965f-f86c49a2664e/copy-manifests/0.log"
Jul 21 17:15:30.913470 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:30.913440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54b99c46f6-n6xtm_3ff63e47-bb00-43eb-98f8-70863329b5e6/manager/0.log"
Jul 21 17:15:31.537897 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:31.537858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vm87z_a686eb97-0c87-4c68-909b-9d964380ce4e/payload-pre-processing/0.log"
Jul 21 17:15:31.569834 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:31.569804    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58b59cb77b-zj22b_ff6d6bd9-9abb-4693-a65f-0cc455f79821/router/0.log"
Jul 21 17:15:33.104678 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:33.104644    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vm87z_a686eb97-0c87-4c68-909b-9d964380ce4e/payload-pre-processing/0.log"
Jul 21 17:15:33.143964 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:33.143934    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58b59cb77b-zj22b_ff6d6bd9-9abb-4693-a65f-0cc455f79821/router/0.log"
Jul 21 17:15:36.556662 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:36.556614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dqr7v_bf01c60c-b30a-4e40-a66f-0aeb994d311f/migrator/0.log"
Jul 21 17:15:36.582235 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:36.582210    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dqr7v_bf01c60c-b30a-4e40-a66f-0aeb994d311f/graceful-termination/0.log"
Jul 21 17:15:36.937571 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:36.937490    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gmjft_708be621-6f4a-4a77-89b2-95fb2b98a435/kube-storage-version-migrator-operator/1.log"
Jul 21 17:15:36.938293 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:36.938274    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gmjft_708be621-6f4a-4a77-89b2-95fb2b98a435/kube-storage-version-migrator-operator/0.log"
Jul 21 17:15:37.948936 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:37.948910    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/kube-multus-additional-cni-plugins/0.log"
Jul 21 17:15:37.986005 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:37.985977    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/egress-router-binary-copy/0.log"
Jul 21 17:15:38.030748 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:38.030718    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/cni-plugins/0.log"
Jul 21 17:15:38.052601 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:38.052574    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/bond-cni-plugin/0.log"
Jul 21 17:15:38.074519 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:38.074494    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/routeoverride-cni/0.log"
Jul 21 17:15:38.099012 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:38.098992    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/whereabouts-cni-bincopy/0.log"
Jul 21 17:15:38.121551 ip-10-0-129-98 kubenswrapper[2575]: I0721 17:15:38.121518    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fhjx_7fb1e19a-cf5c-4c19-861c-fa81934b8727/whereabouts-cni/0.log"