Aug 04 11:31:07.392716 ip-10-0-129-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 11:31:07.392728 ip-10-0-129-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 11:31:07.392735 ip-10-0-129-1 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 11:31:07.392960 ip-10-0-129-1 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 11:31:17.418873 ip-10-0-129-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 11:31:17.418890 ip-10-0-129-1 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 902b6c42e5234beca969f851023c5efc --
Aug 04 11:33:11.705651 ip-10-0-129-1 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 11:33:12.095342 ip-10-0-129-1 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 11:33:12.095342 ip-10-0-129-1 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 11:33:12.095342 ip-10-0-129-1 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 11:33:12.095342 ip-10-0-129-1 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 11:33:12.095342 ip-10-0-129-1 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 11:33:12.096264 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.096180    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 11:33:12.100322 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100306    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 11:33:12.100322 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100322    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100327    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100330    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100334    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100337    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100342    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100345    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100348    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100351    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100354    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100359    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100362    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100365    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100368    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100371    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100374    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100377    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100380    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100383    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 11:33:12.100391 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100386    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100393    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100396    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100399    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100416    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100420    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100424    2582 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100426    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100429    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100432    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100435    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100438    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100441    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100444    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100447    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100450    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100453    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100456    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100459    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 11:33:12.100851 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100461    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100464    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100467    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100469    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100472    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100475    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100478    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100480    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100482    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100485    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100488    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100490    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100493    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100495    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100498    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100502    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100504    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100507    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100510    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100513    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 11:33:12.101316 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100515    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100518    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100520    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100523    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100526    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100528    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100531    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100533    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100536    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100538    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100541    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100543    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100546    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100549    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100552    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100554    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100556    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100559    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100561    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100564    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 11:33:12.101842 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100567    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100570    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100572    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100575    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100577    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100580    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100584    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100587    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100590    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100592    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100595    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100598    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100600    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100603    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100605    2582 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100608    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100610    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100613    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100615    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.100618    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 11:33:12.102342 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101315    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101321    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101324    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101328    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101330    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101333    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101336    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101339    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101341    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101344    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101347    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101350    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101353    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101358    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101361    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101364    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101367    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101370    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101373    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 11:33:12.102825 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101376    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101379    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101381    2582 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101384    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101386    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101389    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101391    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101394    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101396    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101399    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101414    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101417    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101420    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101423    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101425    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101428    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101431    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101433    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101436    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101439    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 11:33:12.103394 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101442    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101444    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101447    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101449    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101452    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101454    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101457    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101460    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101463    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101465    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101469    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101472    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101474    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101477    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101479    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101482    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101484    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101487    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101490    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 11:33:12.103886 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101492    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101495    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101497    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101500    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101502    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101504    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101507    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101510    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101513    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101515    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101518    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101520    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101523    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101526    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101529    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101531    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101534    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101536    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101539    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101542    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 11:33:12.104332 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101544    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101547    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101550    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101554    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101556    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101559    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101563    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101566    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101569    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101571    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101574    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101577    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101580    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101582    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101585    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101587    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101590    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101594    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101597    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 11:33:12.104815 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101600    2582 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101603    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101950    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101955    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101958    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101961    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101965    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101967    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101970    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101973    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101976    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101980    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101983    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101985    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101988    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101991    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101994    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101997    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.101999    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 11:33:12.105270 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102002    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102004    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102007    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102010    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102013    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102015    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102018    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102021    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102023    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102025    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102028    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102030    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102033    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102036    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102039    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102042    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102046    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102049    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102053    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 11:33:12.105730 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102056    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102059    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102061    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102064    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102067    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102069    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102073    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102075    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102077    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102081    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102083    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102086    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102088    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102091    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102093    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102096    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102098    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102102    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102105    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 11:33:12.106178 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102108    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102111    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102113    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102116    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102118    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102121    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102123    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102126    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102128    2582 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102131    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102133    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102136    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102138    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102141    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102143    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102147    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102150    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102153    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102156    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102159    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 11:33:12.106670 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102161    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102164    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102166    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102169    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102172    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102174    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102177    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102179    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102182    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102184    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102187    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102189    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102192    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102194    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102197    2582 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102199    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102202    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102204    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102207    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102209    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 11:33:12.107144 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102212    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102214    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102216    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102219    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102290    2582 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102297    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102302    2582 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102307    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102311    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102314    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102324    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102328    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102331    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102334    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102338    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102341    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102344    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102348    2582 flags.go:64] FLAG: --cgroup-root=""
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102351    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102354    2582 flags.go:64] FLAG: --client-ca-file=""
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102357    2582 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102360    2582 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102366    2582 flags.go:64] FLAG: --cluster-domain=""
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102369    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 11:33:12.107633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102371    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102375    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102378    2582 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102382    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102385    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102387    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102391    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102394    2582 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102396    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102399    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102414    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102417    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102421    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102424    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102426    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102429    2582 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102432    2582 flags.go:64] FLAG: --enable-server="true"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102436    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102444    2582 flags.go:64] FLAG: --event-burst="100"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102447    2582 flags.go:64] FLAG: --event-qps="50"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102450    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102453    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102456    2582 flags.go:64] FLAG: --eviction-hard=""
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102459    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 11:33:12.108197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102462    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102465    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102468    2582 flags.go:64] FLAG: --eviction-soft=""
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102471    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102474    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102477    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102480    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102483    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102486    2582 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102488    2582 flags.go:64] FLAG: --feature-gates=""
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102492    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102495    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102498    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102501    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102503    2582 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102506    2582 flags.go:64] FLAG: --help="false"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102509    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102512    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102515    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102518    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102521    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102524    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102527    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 11:33:12.108770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102530    2582 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102532    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102535    2582 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102544    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102547    2582 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102550    2582 flags.go:64] FLAG: --kube-reserved=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102553    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102556    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102559    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102562    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102565    2582 flags.go:64] FLAG: --lock-file=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102568    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102571    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102574    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102579    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102582    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102585    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102588    2582 flags.go:64] FLAG: --logging-format="text"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102591    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102594    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102597    2582 flags.go:64] FLAG: --manifest-url=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102600    2582 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102604    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102607    2582 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102611    2582 flags.go:64] FLAG: --max-pods="110"
Aug 04 11:33:12.109353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102614    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102616    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102619    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102622    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102625    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102628    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102631    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102637    2582 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102640    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102643    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102648    2582 flags.go:64] FLAG: --pod-cidr=""
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102652    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102656    2582 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102659    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102662    2582 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102665    2582 flags.go:64] FLAG: --port="10250"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102668    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102671    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00bb78b4ca75c3871"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102674    2582 flags.go:64] FLAG: --qos-reserved=""
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102677    2582 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102680    2582 flags.go:64] FLAG: --register-node="true"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102683    2582 flags.go:64] FLAG: --register-with-taints=""
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102687    2582 flags.go:64] FLAG: --registry-burst="10"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102690    2582 flags.go:64] FLAG: --registry-qps="5"
Aug 04 11:33:12.110004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102692    2582 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102695    2582 flags.go:64] FLAG: --reserved-memory=""
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102699    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102701    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102705    2582 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102707    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102710    2582 flags.go:64] FLAG: --runonce="false"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102713    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102716    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102719    2582 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102722    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102725    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102728    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102730    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102733    2582 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102736    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102739    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102742    2582 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102746    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102750    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102754    2582 flags.go:64] FLAG: --system-cgroups=""
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102756    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102761    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102764    2582 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102767    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 11:33:12.110594 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102771    2582 flags.go:64] FLAG: --tls-min-version=""
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102774    2582 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102776    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102780    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102782    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102785    2582 flags.go:64] FLAG: --v="2"
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102789    2582 flags.go:64] FLAG: --version="false"
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102792    2582 flags.go:64] FLAG: --vmodule=""
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102796    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.102799    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102911    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102914    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102917    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102920    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102923    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102925    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102927    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102930    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102932    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102935    2582 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102938    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102940    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 11:33:12.111181 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102943    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102945    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102948    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102953    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102958    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102962    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102966    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102969    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102977    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102980    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102983    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102986    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102989    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102991    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102994    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102996    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.102998    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103001    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103004    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103006    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 11:33:12.111718 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103009    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103011    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103013    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103016    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103019    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103021    2582 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103024    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103026    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103029    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103031    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103034    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103037    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103039    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103042    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103045    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103049    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103053    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103055    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103058    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103061    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 11:33:12.112202 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103063    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103066    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103069    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103071    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103074    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103076    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103079    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103081    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103084    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103087    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103089    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103092    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103094    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103097    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103099    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103102    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103104    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103107    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103109    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103112    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 11:33:12.112696 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103115    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103117    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103120    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103122    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103125    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103127    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103130    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103134    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103138    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103142    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103146    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103149    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103152    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103154    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103158    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103161    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103164    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103167    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103169    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 11:33:12.113170 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103172    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103175    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103177    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103180    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103182    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103185    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103187    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.103189    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.104706    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.111019    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.111034    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.111728    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.111735    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111791    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111798    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 11:33:12.113650 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111801    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111805    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111807    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111810    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111813    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111816    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111818    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111821    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111824    2582 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111827    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111829    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111832    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111835    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111838    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111840    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111843    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111845    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111848    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111851    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111854    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 11:33:12.114020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111857    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111859    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111862    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111864    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111868    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111872    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111875    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111880    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111882    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111885    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111888    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111890    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111892    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111895    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111897    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111900    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111903    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111906    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111909    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111912    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 11:33:12.114499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111914    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111917    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111920    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111922    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111925    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111927    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111930    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111933    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111935    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111938    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111940    2582 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111943    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111946    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111948    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111950    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111953    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111956    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111958    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111961    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111964    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 11:33:12.114969 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111967    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111970    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111972    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111975    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111978    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111980    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111983    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111985    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111988    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111990    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111993    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111995    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.111998    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112001    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112003    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112005    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112008    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112011    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112014    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112016    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 11:33:12.115485 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112019    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112021    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112023    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112026    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112028    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112032    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112036    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112039    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112042    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112045    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112049    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112051    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112054    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112057    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112060    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112063    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 11:33:12.115964 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112067    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.112072    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112185    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112189    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112193    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112196    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112198    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112201    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112204    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112207    2582 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112210    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112213    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112216    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112219    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112222    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 11:33:12.116339 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112225    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112227    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112230    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112232    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112235    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112238    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112240    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112243    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112245    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112248    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112251    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112254    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112257    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112260    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112262    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112265    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112268    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112270    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112273    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112275    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 11:33:12.116709 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112278    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112280    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112283    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112285    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112288    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112290    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112293    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112297    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112300    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112302    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112306    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112309    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112312    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112315    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112318    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112320    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112324    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112327    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112329    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 11:33:12.117191 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112332    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112334    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112336    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112339    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112342    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112345    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112347    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112350    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112352    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112355    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112358    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112360    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112363    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112366    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112368    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112370    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112373    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112376    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112378    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 11:33:12.117982 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112381    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112383    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112385    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112388    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112390    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112393    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112395    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112398    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112400    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112417    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112422    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112426    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112430    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112434    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112438    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112443    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112446    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112448    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112451    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112454    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 11:33:12.118612 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112457    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112460    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112462    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112466    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112468    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112471    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112473    2582 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:12.112477    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.112482    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.112588    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.114336    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.115562    2582 server.go:1019] "Starting client certificate rotation"
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.115661    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 11:33:12.119252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.117365    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 11:33:12.121085 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.121071    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 11:33:12.122183 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.122168    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 11:33:12.136982 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.136962    2582 log.go:25] "Validated CRI v1 runtime API"
Aug 04 11:33:12.139083 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.139070    2582 log.go:25] "Validated CRI v1 image API"
Aug 04 11:33:12.139845 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.139828    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 11:33:12.141951 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.141932    2582 fs.go:135] Filesystem UUIDs: map[7685fdd6-4896-4e03-81a8-a2878d628eb3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c18cc1a9-4d6d-4c1c-b691-91aad11e6cc0:/dev/nvme0n1p4]
Aug 04 11:33:12.142018 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.141950    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 11:33:12.146557 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.146541    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 11:33:12.146983 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.146876    2582 manager.go:216] Machine: {Timestamp:2026-08-04 11:33:12.145489049 +0000 UTC m=+0.319975041 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3195705 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d82fd53ed2527cdf2ce82862b84e8 SystemUUID:ec2d82fd-53ed-2527-cdf2-ce82862b84e8 BootID:902b6c42-e523-4bec-a969-f851023c5efc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:13:7a:2f:3f:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:13:7a:2f:3f:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:42:90:32:68:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 11:33:12.146983 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.146980    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 11:33:12.147100 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.147085    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 11:33:12.150310 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.150285    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 11:33:12.150448 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.150313    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 11:33:12.150997 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.150988    2582 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 11:33:12.151026 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.151000    2582 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 11:33:12.151026 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.151012    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 11:33:12.151589 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.151580    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 11:33:12.152773 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.152764    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 11:33:12.156062 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156051    2582 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 11:33:12.156167 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156158    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 11:33:12.156200 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156187    2582 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 11:33:12.156200 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156195    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 11:33:12.156252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156206    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 11:33:12.156252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156215    2582 kubelet.go:398] "Adding apiserver pod source"
Aug 04 11:33:12.156252 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156223    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 11:33:12.156675 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156643    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 11:33:12.156675 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.156681    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 11:33:12.161231 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.161207    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 11:33:12.162605 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.162592    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 11:33:12.162659 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.162623    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 11:33:12.163308 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163297    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 11:33:12.163339 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163314    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 11:33:12.163339 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163321    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 11:33:12.163339 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163326    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 11:33:12.163339 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163334    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 11:33:12.163339 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163340    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 11:33:12.163515 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163506    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 11:33:12.163546 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163516    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 11:33:12.163546 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163523    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 11:33:12.163546 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163529    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 11:33:12.163546 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163538    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 11:33:12.163546 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.163545    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 11:33:12.164888 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.164877    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 11:33:12.164921 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.164889    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 11:33:12.166579 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.166550    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 11:33:12.166579 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.166572    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 11:33:12.166689 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.166672    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 11:33:12.168353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.168340    2582 server.go:1268] "Started kubelet"
Aug 04 11:33:12.168462 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.168438    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 11:33:12.168513 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.168445    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 11:33:12.168513 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.168505    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 11:33:12.169129 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.168996    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krdqk"
Aug 04 11:33:12.169266 ip-10-0-129-1 systemd[1]: Started Kubernetes Kubelet.
Aug 04 11:33:12.169599 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.169580    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 11:33:12.169981 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.169969    2582 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 11:33:12.173800 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.172898    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-1.ec2.internal.18c896ebe5bdeab0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-1.ec2.internal,UID:ip-10-0-129-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-1.ec2.internal,},FirstTimestamp:2026-08-04 11:33:12.168311472 +0000 UTC m=+0.342797464,LastTimestamp:2026-08-04 11:33:12.168311472 +0000 UTC m=+0.342797464,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-1.ec2.internal,}"
Aug 04 11:33:12.174253 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.174237    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 11:33:12.175620 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.175602    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 11:33:12.175693 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.175640    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 11:33:12.175761 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.175739    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.176209 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176176    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 11:33:12.176209 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176174    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 11:33:12.176209 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176200    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 11:33:12.176391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176282    2582 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 11:33:12.176391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176292    2582 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 11:33:12.176736 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176717    2582 factory.go:55] Registering systemd factory
Aug 04 11:33:12.176825 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176739    2582 factory.go:223] Registration of the systemd container factory successfully
Aug 04 11:33:12.176919 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176907    2582 factory.go:153] Registering CRI-O factory
Aug 04 11:33:12.176919 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176919    2582 factory.go:223] Registration of the crio container factory successfully
Aug 04 11:33:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176969    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 11:33:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176988    2582 factory.go:103] Registering Raw factory
Aug 04 11:33:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176997    2582 manager.go:1196] Started watching for new ooms in manager
Aug 04 11:33:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.176997    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krdqk"
Aug 04 11:33:12.177478 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.177462    2582 manager.go:349] Starting recovery of all containers
Aug 04 11:33:12.185991 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.185974    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:12.188451 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.188435    2582 manager.go:354] Recovery completed
Aug 04 11:33:12.188754 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.188730    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.192849 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.192837    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.194583 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.194561    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.194665 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.194593    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.194665 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.194609    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.195068 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195056    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 11:33:12.195068 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195067    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 11:33:12.195183 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195074    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.195183 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195086    2582 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 11:33:12.195769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195756    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.195828 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195783    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.195828 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.195793    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.196275 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.196262    2582 policy_none.go:49] "None policy: Start"
Aug 04 11:33:12.196329 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.196280    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 11:33:12.196329 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.196294    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 11:33:12.197293 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.197280    2582 policy_none.go:47] "Start"
Aug 04 11:33:12.237054 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.236890    2582 manager.go:337] "Starting Device Plugin manager"
Aug 04 11:33:12.237139 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.237069    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 11:33:12.237139 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.237081    2582 server.go:87] "Starting device plugin registration server"
Aug 04 11:33:12.237293 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.237282    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 11:33:12.237324 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.237297    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 11:33:12.237416 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.237383    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 11:33:12.237515 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.237477    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 11:33:12.237515 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.237486    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 11:33:12.237985 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.237964    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 11:33:12.238049 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.238017    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.337453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.337427    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.338348 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.338332    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.338458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.338363    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.338458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.338377    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.338458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.338411    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.341860 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.341823    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 11:33:12.343115 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.343098    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 11:33:12.343168 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.343136    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 11:33:12.343168 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.343159    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 11:33:12.343261 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.343191    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 11:33:12.345986 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.345937    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.345986 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.345957    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-1.ec2.internal\": node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.347074 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.347057    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:12.378337 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.378306    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.447680 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.447650    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"]
Aug 04 11:33:12.447790 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.447738    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.448668 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.448654    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.448726 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.448683    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.448726 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.448696    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.450467 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.450455    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.450595 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.450571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.450661 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.450598    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.451126 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.451111    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.451199 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.451131    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.451199 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.451140    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.451199 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.451152    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.451199 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.451156    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.451199 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.451165    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.452555 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.452540    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.452607 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.452578    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 11:33:12.453272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.453255    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 11:33:12.453357 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.453283    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 11:33:12.453357 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.453295    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Aug 04 11:33:12.468105 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.468082    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.472221 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.472204    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.477583 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.477564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97560ccf02a1820c065a7371bf3c35a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"97560ccf02a1820c065a7371bf3c35a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.477651 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.477591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0a1c5c3ab5f0df54822ebe73b3038ef-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"b0a1c5c3ab5f0df54822ebe73b3038ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.477651 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.477609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97560ccf02a1820c065a7371bf3c35a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"97560ccf02a1820c065a7371bf3c35a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.478605 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.478590    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.578320 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.578293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97560ccf02a1820c065a7371bf3c35a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"97560ccf02a1820c065a7371bf3c35a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.578320 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.578324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97560ccf02a1820c065a7371bf3c35a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"97560ccf02a1820c065a7371bf3c35a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.578529 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.578348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0a1c5c3ab5f0df54822ebe73b3038ef-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"b0a1c5c3ab5f0df54822ebe73b3038ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.578529 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.578405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0a1c5c3ab5f0df54822ebe73b3038ef-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"b0a1c5c3ab5f0df54822ebe73b3038ef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.578529 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.578396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97560ccf02a1820c065a7371bf3c35a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"97560ccf02a1820c065a7371bf3c35a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.578529 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.578401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97560ccf02a1820c065a7371bf3c35a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"97560ccf02a1820c065a7371bf3c35a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.579352 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.579335    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.680085 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.680004    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.771691 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.771637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.782388 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.782362    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.782388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:12.782371    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:12.883486 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.883453    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:12.983579 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:12.983504    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Aug 04 11:33:13.075760 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.075734    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:13.075907 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.075840    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:13.087891 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.087868    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 11:33:13.089509 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.089496    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Aug 04 11:33:13.098915 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.098897    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 11:33:13.107482 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.107461    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:13.114861 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.114834    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 11:33:13.114978 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.114960    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 11:33:13.115043 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.114985    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 11:33:13.115043 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.114996    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 11:33:13.115043 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.115023    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 11:33:13.157641 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.157617    2582 apiserver.go:52] "Watching apiserver"
Aug 04 11:33:13.176246 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.176221    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 11:33:13.177567 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.177549    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 11:33:13.177915 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.177894    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-pn287","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal","openshift-multus/multus-cdtj2","openshift-ovn-kubernetes/ovnkube-node-slfmj","openshift-dns/node-resolver-v9lmc","openshift-image-registry/node-ca-97jv5","openshift-multus/multus-additional-cni-plugins-w4d9c","openshift-multus/network-metrics-daemon-745xn","openshift-network-diagnostics/network-check-target-qcg9t","openshift-network-operator/iptables-alerter-4vt4n","kube-system/global-pull-secret-syncer-chq84","kube-system/konnectivity-agent-8wmgk","kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"]
Aug 04 11:33:13.179432 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.179404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.180369 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.180316    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 11:28:12 +0000 UTC" deadline="2028-01-29 15:31:39.134090695 +0000 UTC"
Aug 04 11:33:13.180369 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.180365    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13035h58m25.953727899s"
Aug 04 11:33:13.180542 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.180391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.181344 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.181318    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.181435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.181347    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.181435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.181380    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hp5mm\""
Aug 04 11:33:13.181960 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.181944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.182257 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.182238    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.182385 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.182291    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 11:33:13.182503 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.182483    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8r8kt\""
Aug 04 11:33:13.182578 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.182552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 11:33:13.182638 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.182622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.183222 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.183207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.183632 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.183615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.183785 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.183770    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.184066 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184048    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 11:33:13.184203 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184186    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 11:33:13.184308 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184219    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 11:33:13.184308 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184293    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5bck5\""
Aug 04 11:33:13.184428 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184220    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 11:33:13.184577 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.184623 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.184592    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 11:33:13.185064 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.185045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hpwf7\""
Aug 04 11:33:13.185158 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.185049    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.185158 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.185095    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.185908 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.185891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.186494 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.186474    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.186576 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.186498    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sq4gc\""
Aug 04 11:33:13.186576 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.186481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 11:33:13.186742 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.186727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.187276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.187258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.187384 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.187359    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:13.187512 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.187493    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 11:33:13.187929 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.187908    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 11:33:13.188073 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.188055    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nf4q8\""
Aug 04 11:33:13.188628 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.188615    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:13.188693 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.188676    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:13.189732 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.189716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.190895 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.190875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.190996 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.190948    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:13.191570 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.191551    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.191751 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.191729    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.191849 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.191806    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 11:33:13.191939 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.191924    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rzxnk\""
Aug 04 11:33:13.192808 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.192301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.194620 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.194226    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 11:33:13.194620 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.194376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.194620 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.194397    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nsnmf\""
Aug 04 11:33:13.195396 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.194843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 11:33:13.196991 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.196972    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 11:33:13.197066 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.196996    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 11:33:13.197128 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.197116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sb42h\""
Aug 04 11:33:13.197184 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.197150    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 11:33:13.215742 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.215723    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8kgpz"
Aug 04 11:33:13.226279 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.226257    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8kgpz"
Aug 04 11:33:13.278089 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.278066    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 11:33:13.285336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-systemd\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.285436 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.285436 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-ovnkube-script-lib\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.285436 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285375    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.285436 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-cni-bin\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysctl-d\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48a31f1f-bc82-4402-86b6-26de7ba1d6de-serviceca\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-cnibin\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9bm2\" (UniqueName: \"kubernetes.io/projected/993330bc-f4b7-44db-98b6-78c8112c525e-kube-api-access-h9bm2\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-registration-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-os-release\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.285643 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-hostroot\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-daemon-config\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddvz2\" (UniqueName: \"kubernetes.io/projected/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-kube-api-access-ddvz2\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-node-log\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-system-cni-dir\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-modprobe-d\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-host\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-tuned\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-system-cni-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285889    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-cni-multus\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxw5\" (UniqueName: \"kubernetes.io/projected/83545514-c89f-4911-a801-7baebbb9d89e-kube-api-access-dvxw5\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.285986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989n5\" (UniqueName: \"kubernetes.io/projected/48a31f1f-bc82-4402-86b6-26de7ba1d6de-kube-api-access-989n5\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-var-lib-kubelet\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-host-slash\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.286032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83545514-c89f-4911-a801-7baebbb9d89e-hosts-file\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-kubernetes\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb-agent-certs\") pod \"konnectivity-agent-8wmgk\" (UID: \"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb\") " pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-cni-binary-copy\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-run\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-cni-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-etc-kubernetes\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-iptables-alerter-script\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/254d88f0-4553-4400-83e1-9210c23a98a7-dbus\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfnr4\" (UniqueName: \"kubernetes.io/projected/5a70985f-5b44-4320-abd9-7c1a7e076929-kube-api-access-bfnr4\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-socket-dir-parent\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-etc-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-device-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-sys-fs\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.286757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-cni-bin\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb-konnectivity-ca\") pod \"konnectivity-agent-8wmgk\" (UID: \"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb\") " pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-ovnkube-config\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd618792-a4bd-49be-bff5-163003816894-ovn-node-metrics-cert\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjkvw\" (UniqueName: \"kubernetes.io/projected/fd618792-a4bd-49be-bff5-163003816894-kube-api-access-wjkvw\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48a31f1f-bc82-4402-86b6-26de7ba1d6de-host\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxkt\" (UniqueName: \"kubernetes.io/projected/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-kube-api-access-jzxkt\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysctl-conf\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-k8s-cni-cncf-io\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-systemd-units\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-cnibin\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-cni-binary-copy\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-kubelet\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-multus-certs\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:13.287336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-ovn\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-log-socket\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-run-ovn-kubernetes\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83545514-c89f-4911-a801-7baebbb9d89e-tmp-dir\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-os-release\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-systemd\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g624s\" (UniqueName: \"kubernetes.io/projected/1244d88a-5e2a-46e2-b042-3904a00891f0-kube-api-access-g624s\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.286985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-run-netns\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-var-lib-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysconfig\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1244d88a-5e2a-46e2-b042-3904a00891f0-tmp\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-netns\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fst\" (UniqueName: \"kubernetes.io/projected/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-kube-api-access-w6fst\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/254d88f0-4553-4400-83e1-9210c23a98a7-kubelet-config\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-kubelet\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.287834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-slash\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.288319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-cni-netd\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.288319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-env-overrides\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.288319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-socket-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.288319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-lib-modules\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.288319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-sys\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.288319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.287358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-conf-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.320800 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.320774    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97560ccf02a1820c065a7371bf3c35a7.slice/crio-9d73ee912bb666d522e10cfd8699df6e6fc46fbef98832f93a88e33be7face08 WatchSource:0}: Error finding container 9d73ee912bb666d522e10cfd8699df6e6fc46fbef98832f93a88e33be7face08: Status 404 returned error can't find the container with id 9d73ee912bb666d522e10cfd8699df6e6fc46fbef98832f93a88e33be7face08
Aug 04 11:33:13.321107 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.321085    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a1c5c3ab5f0df54822ebe73b3038ef.slice/crio-6a36f3c27c930e6be2842b8be9798f3b4ba46332f8007f25241527a4ba55d41a WatchSource:0}: Error finding container 6a36f3c27c930e6be2842b8be9798f3b4ba46332f8007f25241527a4ba55d41a: Status 404 returned error can't find the container with id 6a36f3c27c930e6be2842b8be9798f3b4ba46332f8007f25241527a4ba55d41a
Aug 04 11:33:13.326476 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.326459    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 11:33:13.347380 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.347336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"97560ccf02a1820c065a7371bf3c35a7","Type":"ContainerStarted","Data":"9d73ee912bb666d522e10cfd8699df6e6fc46fbef98832f93a88e33be7face08"}
Aug 04 11:33:13.348356 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.348333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" event={"ID":"b0a1c5c3ab5f0df54822ebe73b3038ef","Type":"ContainerStarted","Data":"6a36f3c27c930e6be2842b8be9798f3b4ba46332f8007f25241527a4ba55d41a"}
Aug 04 11:33:13.387687 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-host-slash\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.387811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83545514-c89f-4911-a801-7baebbb9d89e-hosts-file\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.387811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-kubernetes\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.387811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb-agent-certs\") pod \"konnectivity-agent-8wmgk\" (UID: \"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb\") " pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.387811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-host-slash\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.387811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-cni-binary-copy\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.387811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-run\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83545514-c89f-4911-a801-7baebbb9d89e-hosts-file\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-cni-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-kubernetes\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-etc-kubernetes\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-iptables-alerter-script\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/254d88f0-4553-4400-83e1-9210c23a98a7-dbus\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfnr4\" (UniqueName: \"kubernetes.io/projected/5a70985f-5b44-4320-abd9-7c1a7e076929-kube-api-access-bfnr4\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-socket-dir-parent\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.387988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-etc-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-run\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-cni-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-device-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388059    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-etc-kubernetes\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388090    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-socket-dir-parent\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-sys-fs\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-etc-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/254d88f0-4553-4400-83e1-9210c23a98a7-dbus\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388155    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-sys-fs\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-device-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-cni-bin\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb-konnectivity-ca\") pod \"konnectivity-agent-8wmgk\" (UID: \"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb\") " pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-ovnkube-config\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd618792-a4bd-49be-bff5-163003816894-ovn-node-metrics-cert\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjkvw\" (UniqueName: \"kubernetes.io/projected/fd618792-a4bd-49be-bff5-163003816894-kube-api-access-wjkvw\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48a31f1f-bc82-4402-86b6-26de7ba1d6de-host\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxkt\" (UniqueName: \"kubernetes.io/projected/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-kube-api-access-jzxkt\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysctl-conf\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-k8s-cni-cncf-io\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-systemd-units\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-cni-binary-copy\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.388965 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48a31f1f-bc82-4402-86b6-26de7ba1d6de-host\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-cnibin\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388240    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-cni-binary-copy\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-cnibin\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-kubelet\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-kubelet\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-multus-certs\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-k8s-cni-cncf-io\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-ovn\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-ovnkube-config\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-log-socket\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388937    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb-konnectivity-ca\") pod \"konnectivity-agent-8wmgk\" (UID: \"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb\") " pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-systemd-units\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.389818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.388986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-run-ovn-kubernetes\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-cni-bin\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83545514-c89f-4911-a801-7baebbb9d89e-tmp-dir\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-multus-certs\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-run-ovn-kubernetes\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-os-release\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-ovn\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-systemd\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389152    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-os-release\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g624s\" (UniqueName: \"kubernetes.io/projected/1244d88a-5e2a-46e2-b042-3904a00891f0-kube-api-access-g624s\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysctl-conf\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-run-netns\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-var-lib-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysconfig\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389279    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1244d88a-5e2a-46e2-b042-3904a00891f0-tmp\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-netns\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389295    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-cni-binary-copy\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.390686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fst\" (UniqueName: \"kubernetes.io/projected/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-kube-api-access-w6fst\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-iptables-alerter-script\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/254d88f0-4553-4400-83e1-9210c23a98a7-kubelet-config\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-log-socket\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-run-netns\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-kubelet\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389412    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83545514-c89f-4911-a801-7baebbb9d89e-tmp-dir\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-systemd\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-slash\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-cni-netd\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-env-overrides\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-var-lib-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/254d88f0-4553-4400-83e1-9210c23a98a7-kubelet-config\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-socket-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-kubelet\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-lib-modules\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysconfig\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.391563 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.389549    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-run-netns\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389584    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-slash\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389610    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-sys\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.389639    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:13.889617922 +0000 UTC m=+2.064103905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-cni-netd\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389652    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-lib-modules\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-socket-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-sys\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-conf-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-systemd\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-conf-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-ovnkube-script-lib\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-openvswitch\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389939    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-run-systemd\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.392420 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.389953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-cni-bin\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-env-overrides\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysctl-d\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48a31f1f-bc82-4402-86b6-26de7ba1d6de-serviceca\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-cni-bin\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-cnibin\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9bm2\" (UniqueName: \"kubernetes.io/projected/993330bc-f4b7-44db-98b6-78c8112c525e-kube-api-access-h9bm2\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-registration-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390235    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-sysctl-d\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-os-release\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.390325    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.390378    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:33:13.89036162 +0000 UTC m=+2.064847604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-hostroot\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-daemon-config\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fd618792-a4bd-49be-bff5-163003816894-ovnkube-script-lib\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddvz2\" (UniqueName: \"kubernetes.io/projected/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-kube-api-access-ddvz2\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a70985f-5b44-4320-abd9-7c1a7e076929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-hostroot\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-node-log\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-system-cni-dir\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-modprobe-d\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-node-log\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-system-cni-dir\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-modprobe-d\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-os-release\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a70985f-5b44-4320-abd9-7c1a7e076929-cnibin\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-registration-dir\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-host\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-tuned\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-system-cni-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-host\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-cni-multus\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.393692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.390994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-multus-daemon-config\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxw5\" (UniqueName: \"kubernetes.io/projected/83545514-c89f-4911-a801-7baebbb9d89e-kube-api-access-dvxw5\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-system-cni-dir\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989n5\" (UniqueName: \"kubernetes.io/projected/48a31f1f-bc82-4402-86b6-26de7ba1d6de-kube-api-access-989n5\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-var-lib-kubelet\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391190    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd618792-a4bd-49be-bff5-163003816894-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1244d88a-5e2a-46e2-b042-3904a00891f0-var-lib-kubelet\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-host-var-lib-cni-multus\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.391583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48a31f1f-bc82-4402-86b6-26de7ba1d6de-serviceca\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.393144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1244d88a-5e2a-46e2-b042-3904a00891f0-tmp\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.393195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1244d88a-5e2a-46e2-b042-3904a00891f0-etc-tuned\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.393217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd618792-a4bd-49be-bff5-163003816894-ovn-node-metrics-cert\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.394287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.393340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb-agent-certs\") pod \"konnectivity-agent-8wmgk\" (UID: \"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb\") " pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.395862 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.395824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfnr4\" (UniqueName: \"kubernetes.io/projected/5a70985f-5b44-4320-abd9-7c1a7e076929-kube-api-access-bfnr4\") pod \"multus-additional-cni-plugins-w4d9c\" (UID: \"5a70985f-5b44-4320-abd9-7c1a7e076929\") " pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.395965 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.395950    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:13.396014 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.395974    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:13.396014 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.395988    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:13.396089 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.396056    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:33:13.896038963 +0000 UTC m=+2.070524968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:13.396281 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.396260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjkvw\" (UniqueName: \"kubernetes.io/projected/fd618792-a4bd-49be-bff5-163003816894-kube-api-access-wjkvw\") pod \"ovnkube-node-slfmj\" (UID: \"fd618792-a4bd-49be-bff5-163003816894\") " pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.396409 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.396372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxkt\" (UniqueName: \"kubernetes.io/projected/c56c2e23-c8b2-4e8c-9edf-036f1bf8f783-kube-api-access-jzxkt\") pod \"aws-ebs-csi-driver-node-m5lcm\" (UID: \"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.397905 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.397881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g624s\" (UniqueName: \"kubernetes.io/projected/1244d88a-5e2a-46e2-b042-3904a00891f0-kube-api-access-g624s\") pod \"tuned-pn287\" (UID: \"1244d88a-5e2a-46e2-b042-3904a00891f0\") " pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.398059 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.398038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fst\" (UniqueName: \"kubernetes.io/projected/db9a9c8d-f6a1-4011-a3cd-1559e0d33315-kube-api-access-w6fst\") pod \"iptables-alerter-4vt4n\" (UID: \"db9a9c8d-f6a1-4011-a3cd-1559e0d33315\") " pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.399012 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.398985    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-989n5\" (UniqueName: \"kubernetes.io/projected/48a31f1f-bc82-4402-86b6-26de7ba1d6de-kube-api-access-989n5\") pod \"node-ca-97jv5\" (UID: \"48a31f1f-bc82-4402-86b6-26de7ba1d6de\") " pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.399540 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.399522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxw5\" (UniqueName: \"kubernetes.io/projected/83545514-c89f-4911-a801-7baebbb9d89e-kube-api-access-dvxw5\") pod \"node-resolver-v9lmc\" (UID: \"83545514-c89f-4911-a801-7baebbb9d89e\") " pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.399951 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.399926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddvz2\" (UniqueName: \"kubernetes.io/projected/0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef-kube-api-access-ddvz2\") pod \"multus-cdtj2\" (UID: \"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef\") " pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.400833 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.400814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9bm2\" (UniqueName: \"kubernetes.io/projected/993330bc-f4b7-44db-98b6-78c8112c525e-kube-api-access-h9bm2\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.503763 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.503675    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pn287"
Aug 04 11:33:13.512499 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.512452    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1244d88a_5e2a_46e2_b042_3904a00891f0.slice/crio-bd43d455326c610e58e0df47e8d0d8ee2079a87893d0421d7f0f2b83dd6a691a WatchSource:0}: Error finding container bd43d455326c610e58e0df47e8d0d8ee2079a87893d0421d7f0f2b83dd6a691a: Status 404 returned error can't find the container with id bd43d455326c610e58e0df47e8d0d8ee2079a87893d0421d7f0f2b83dd6a691a
Aug 04 11:33:13.524603 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.524581    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdtj2"
Aug 04 11:33:13.531482 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.531461    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9e1797_7ec9_4ece_9c6b_bf447f5c4fef.slice/crio-e5fa41e58b742556a167f204a0da842f58408c275b7caff0b6b7f6e8b7e4f901 WatchSource:0}: Error finding container e5fa41e58b742556a167f204a0da842f58408c275b7caff0b6b7f6e8b7e4f901: Status 404 returned error can't find the container with id e5fa41e58b742556a167f204a0da842f58408c275b7caff0b6b7f6e8b7e4f901
Aug 04 11:33:13.535618 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.535601    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:13.542547 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.542524    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd618792_a4bd_49be_bff5_163003816894.slice/crio-098b2a2e9b51f9ca2236eaf3361ec8d30f2845e6c673b7f186aefdbc76f8ce2a WatchSource:0}: Error finding container 098b2a2e9b51f9ca2236eaf3361ec8d30f2845e6c673b7f186aefdbc76f8ce2a: Status 404 returned error can't find the container with id 098b2a2e9b51f9ca2236eaf3361ec8d30f2845e6c673b7f186aefdbc76f8ce2a
Aug 04 11:33:13.553058 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.553041    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9lmc"
Aug 04 11:33:13.558730 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.558709    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97jv5"
Aug 04 11:33:13.561705 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.561686    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83545514_c89f_4911_a801_7baebbb9d89e.slice/crio-54922ad56f5e9464bb78df51af5b261b823c6f51b12384c438a9d97be766d24e WatchSource:0}: Error finding container 54922ad56f5e9464bb78df51af5b261b823c6f51b12384c438a9d97be766d24e: Status 404 returned error can't find the container with id 54922ad56f5e9464bb78df51af5b261b823c6f51b12384c438a9d97be766d24e
Aug 04 11:33:13.566692 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.566672    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a31f1f_bc82_4402_86b6_26de7ba1d6de.slice/crio-4e3c886fcc7610e01519c4ef8d381a446e7c78bd2546f9a76a82716ccd6d8455 WatchSource:0}: Error finding container 4e3c886fcc7610e01519c4ef8d381a446e7c78bd2546f9a76a82716ccd6d8455: Status 404 returned error can't find the container with id 4e3c886fcc7610e01519c4ef8d381a446e7c78bd2546f9a76a82716ccd6d8455
Aug 04 11:33:13.575867 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.575850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w4d9c"
Aug 04 11:33:13.582987 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.582968    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a70985f_5b44_4320_abd9_7c1a7e076929.slice/crio-51ea52de9f9e96d94345c2a2a271903b89be0599bfc2e04370a931662dbdecdd WatchSource:0}: Error finding container 51ea52de9f9e96d94345c2a2a271903b89be0599bfc2e04370a931662dbdecdd: Status 404 returned error can't find the container with id 51ea52de9f9e96d94345c2a2a271903b89be0599bfc2e04370a931662dbdecdd
Aug 04 11:33:13.590226 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.590208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vt4n"
Aug 04 11:33:13.597204 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.597182    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9a9c8d_f6a1_4011_a3cd_1559e0d33315.slice/crio-83dc476d80f81b0700f4c88a266c295e9b24fd74736fb05b337523290a97558d WatchSource:0}: Error finding container 83dc476d80f81b0700f4c88a266c295e9b24fd74736fb05b337523290a97558d: Status 404 returned error can't find the container with id 83dc476d80f81b0700f4c88a266c295e9b24fd74736fb05b337523290a97558d
Aug 04 11:33:13.601403 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.601389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:13.606625 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.606603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm"
Aug 04 11:33:13.608678 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.608662    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffff1c3e_0a2a_42c8_8e4d_ca71ee8f9ebb.slice/crio-9fd97945f6a9564d15e0cb9137b7f344033626a974767d277cb16bb9fc212dc9 WatchSource:0}: Error finding container 9fd97945f6a9564d15e0cb9137b7f344033626a974767d277cb16bb9fc212dc9: Status 404 returned error can't find the container with id 9fd97945f6a9564d15e0cb9137b7f344033626a974767d277cb16bb9fc212dc9
Aug 04 11:33:13.613406 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:13.613381    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56c2e23_c8b2_4e8c_9edf_036f1bf8f783.slice/crio-c7b95fbe48ed44f15eed85383fb06257983db981eebaa303626fa200897637f8 WatchSource:0}: Error finding container c7b95fbe48ed44f15eed85383fb06257983db981eebaa303626fa200897637f8: Status 404 returned error can't find the container with id c7b95fbe48ed44f15eed85383fb06257983db981eebaa303626fa200897637f8
Aug 04 11:33:13.895492 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.895439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:13.895690 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.895502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:13.895690 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.895566    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:13.895690 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.895639    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:14.895619286 +0000 UTC m=+3.070105293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:13.895690 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.895659    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:13.895917 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.895695    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:33:14.895684194 +0000 UTC m=+3.070170191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:13.996622 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:13.996579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:13.996846 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.996824    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:13.996947 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.996887    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:13.996947 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.996902    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:13.997050 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:13.996970    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:33:14.996950295 +0000 UTC m=+3.171436283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:14.206857 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.206440    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:14.228974 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.228903    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 11:28:13 +0000 UTC" deadline="2028-01-10 08:48:33.581046351 +0000 UTC"
Aug 04 11:33:14.228974 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.228966    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12573h15m19.352084908s"
Aug 04 11:33:14.344056 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.344021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:14.344232 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:14.344159    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:14.371421 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.371324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9lmc" event={"ID":"83545514-c89f-4911-a801-7baebbb9d89e","Type":"ContainerStarted","Data":"54922ad56f5e9464bb78df51af5b261b823c6f51b12384c438a9d97be766d24e"}
Aug 04 11:33:14.390775 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.390593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"098b2a2e9b51f9ca2236eaf3361ec8d30f2845e6c673b7f186aefdbc76f8ce2a"}
Aug 04 11:33:14.404198 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.404164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdtj2" event={"ID":"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef","Type":"ContainerStarted","Data":"e5fa41e58b742556a167f204a0da842f58408c275b7caff0b6b7f6e8b7e4f901"}
Aug 04 11:33:14.411349 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.411317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm" event={"ID":"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783","Type":"ContainerStarted","Data":"c7b95fbe48ed44f15eed85383fb06257983db981eebaa303626fa200897637f8"}
Aug 04 11:33:14.418128 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.418100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8wmgk" event={"ID":"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb","Type":"ContainerStarted","Data":"9fd97945f6a9564d15e0cb9137b7f344033626a974767d277cb16bb9fc212dc9"}
Aug 04 11:33:14.430849 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.430824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vt4n" event={"ID":"db9a9c8d-f6a1-4011-a3cd-1559e0d33315","Type":"ContainerStarted","Data":"83dc476d80f81b0700f4c88a266c295e9b24fd74736fb05b337523290a97558d"}
Aug 04 11:33:14.436887 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.436857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pn287" event={"ID":"1244d88a-5e2a-46e2-b042-3904a00891f0","Type":"ContainerStarted","Data":"bd43d455326c610e58e0df47e8d0d8ee2079a87893d0421d7f0f2b83dd6a691a"}
Aug 04 11:33:14.446452 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.446424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerStarted","Data":"51ea52de9f9e96d94345c2a2a271903b89be0599bfc2e04370a931662dbdecdd"}
Aug 04 11:33:14.452788 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.452762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97jv5" event={"ID":"48a31f1f-bc82-4402-86b6-26de7ba1d6de","Type":"ContainerStarted","Data":"4e3c886fcc7610e01519c4ef8d381a446e7c78bd2546f9a76a82716ccd6d8455"}
Aug 04 11:33:14.678216 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.678181    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:14.903904 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.903843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:14.904131 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:14.903931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:14.904231 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:14.904142    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:14.904231 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:14.904222    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:33:16.904197067 +0000 UTC m=+5.078683064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:14.904757 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:14.904730    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:14.904874 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:14.904800    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:16.904781169 +0000 UTC m=+5.079267178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:15.004956 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:15.004855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:15.005149 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:15.005073    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:15.005149 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:15.005101    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:15.005149 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:15.005117    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:15.005313 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:15.005187    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:33:17.005166643 +0000 UTC m=+5.179652644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:15.229890 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:15.229592    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 11:28:13 +0000 UTC" deadline="2028-04-29 04:38:02.79899067 +0000 UTC"
Aug 04 11:33:15.229890 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:15.229637    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15209h4m47.569360128s"
Aug 04 11:33:15.344341 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:15.344258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:15.344551 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:15.344438    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:15.344895 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:15.344875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:15.345011 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:15.344985    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:15.762021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:15.761706    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:16.111152 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:16.111119    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 11:33:16.343654 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:16.343622    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:16.344138 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:16.343778    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:16.922830 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:16.922789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:16.923043 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:16.922857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:16.923115 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:16.923043    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:16.923115 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:16.923109    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:33:20.923089725 +0000 UTC m=+9.097575721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:16.923935 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:16.923526    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:16.923935 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:16.923583    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:20.923566457 +0000 UTC m=+9.098052445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:17.023871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:17.023796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:17.024065 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:17.024037    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:17.024128 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:17.024068    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:17.024128 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:17.024084    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:17.024242 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:17.024157    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:33:21.024131717 +0000 UTC m=+9.198617752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:17.343667 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:17.343585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:17.343667 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:17.343612    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:17.344202 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:17.343723    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:17.344202 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:17.343872    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:18.343872 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:18.343832    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:18.344369 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:18.344005    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:19.344617 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:19.344292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:19.344617 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:19.344456    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:19.344617 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:19.344496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:19.344617 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:19.344612    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:20.344801 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:20.344253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:20.344801 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:20.344423    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:20.958214 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:20.958173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:20.958411 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:20.958235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:20.958411 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:20.958386    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:20.958561 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:20.958474    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:33:28.958432053 +0000 UTC m=+17.132918056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:20.958561 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:20.958529    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:20.958686 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:20.958593    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:28.958572632 +0000 UTC m=+17.133058629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:21.059692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:21.059550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:21.059892 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:21.059821    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:21.059892 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:21.059847    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:21.059892 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:21.059858    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:21.060057 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:21.059908    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:33:29.059893593 +0000 UTC m=+17.234379603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:21.343960 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:21.343873    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:21.343960 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:21.343905    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:21.344202 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:21.344010    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:21.344299 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:21.344218    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:22.344624 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:22.344580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:22.346335 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:22.345911    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:23.345099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:23.344204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:23.345099 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:23.344383    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:23.345099 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:23.344222    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:23.345099 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:23.345055    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:24.343675 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:24.343637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:24.343835 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:24.343787    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:25.343738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:25.343708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:25.344091 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:25.343708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:25.344091 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:25.343801    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:25.344091 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:25.343884    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:26.344190 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:26.344102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:26.344635 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:26.344268    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:27.343569 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:27.343527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:27.343569 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:27.343578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:27.343793 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:27.343675    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:27.343845 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:27.343800    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:28.344232 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:28.344199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:28.344700 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:28.344360    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:29.021046 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:29.021010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:29.021314 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:29.021054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:29.021314 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.021153    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:29.021314 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.021214    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:45.021200666 +0000 UTC m=+33.195686650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:29.021314 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.021153    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:29.021314 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.021285    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:33:45.021272598 +0000 UTC m=+33.195758595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:29.121614 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:29.121568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:29.121799 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.121761    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:29.121799 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.121788    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:29.121799 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.121800    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:29.121958 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.121857    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:33:45.12183904 +0000 UTC m=+33.296325041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:29.344076 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:29.343956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:29.344234 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.344076    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:29.344234 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:29.344138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:29.344598 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:29.344266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:30.344381 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:30.344339    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:30.344801 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:30.344515    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:31.343896 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:31.343851    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:31.344069 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:31.343908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:31.344069 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:31.343995    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:31.344171 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:31.344102    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:32.344360 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:32.344328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:32.344803 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:32.344446    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:33.344427 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:33.344378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:33.344834 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:33.344378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:33.344834 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:33.344532    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:33.344834 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:33.344644    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:34.344531 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.344306    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:34.344960 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:34.344625    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:34.497524 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.497486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pn287" event={"ID":"1244d88a-5e2a-46e2-b042-3904a00891f0","Type":"ContainerStarted","Data":"eea7d20896be29c82ce5a16beffa2ccd75a62fe7b739a5bd3580cdd0791df184"}
Aug 04 11:33:34.499386 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.499357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"ac004abc780874e8ea25e1160c5f0db4d3170044940359160ed730b31e58c5ea"}
Aug 04 11:33:34.502602 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.502444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdtj2" event={"ID":"0b9e1797-7ec9-4ece-9c6b-bf447f5c4fef","Type":"ContainerStarted","Data":"f7b0a92cda26ecb36434494d311c78197a33346678956ed8f70094784ce2329b"}
Aug 04 11:33:34.504004 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.503983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" event={"ID":"b0a1c5c3ab5f0df54822ebe73b3038ef","Type":"ContainerStarted","Data":"d63b0e8124f24fb85e76f37399e972e1d7293d9eb6df3b55412efba67ad982bc"}
Aug 04 11:33:34.533669 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.533630    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pn287" podStartSLOduration=1.073093419 podStartE2EDuration="21.53361566s" totalImagesPullingTime="20.460522241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:34.512288733 +0000 UTC m=+22.686774767" watchObservedRunningTime="2026-08-04 11:33:34.53361566 +0000 UTC m=+22.708101663"
Aug 04 11:33:34.533779 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.533761    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cdtj2" podStartSLOduration=1.077083955 podStartE2EDuration="21.533754507s" totalImagesPullingTime="20.456670552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:34.533478042 +0000 UTC m=+22.707964045" watchObservedRunningTime="2026-08-04 11:33:34.533754507 +0000 UTC m=+22.708240508"
Aug 04 11:33:34.547497 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:34.547456    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" podStartSLOduration=21.547442239 podStartE2EDuration="21.547442239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:34.547364609 +0000 UTC m=+22.721850613" watchObservedRunningTime="2026-08-04 11:33:34.547442239 +0000 UTC m=+22.721928241"
Aug 04 11:33:35.343869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.343801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:35.344102 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.343803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:35.344102 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:35.343938    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:35.344102 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:35.343973    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:35.507047 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.507014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vt4n" event={"ID":"db9a9c8d-f6a1-4011-a3cd-1559e0d33315","Type":"ContainerStarted","Data":"0da51bcfc2ff1410eb0a3e0c5440a0bab7da7d7f130783e30ba051a949669b2c"}
Aug 04 11:33:35.508625 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.508592    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a70985f-5b44-4320-abd9-7c1a7e076929" containerID="65fe9830f95856ebcf01072240eda082d4951b3820efa9af5f4f80ab5136fce9" exitCode=0
Aug 04 11:33:35.508740 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.508673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerDied","Data":"65fe9830f95856ebcf01072240eda082d4951b3820efa9af5f4f80ab5136fce9"}
Aug 04 11:33:35.509969 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.509942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97jv5" event={"ID":"48a31f1f-bc82-4402-86b6-26de7ba1d6de","Type":"ContainerStarted","Data":"d0a13ec5607d181f9fb6d7494399956610878af768522536ac59319e23098ae6"}
Aug 04 11:33:35.511442 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.511397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9lmc" event={"ID":"83545514-c89f-4911-a801-7baebbb9d89e","Type":"ContainerStarted","Data":"22cf759ec17cd3b32cd6c8d8c5831e482f19c800b5ca8917bd32db6e84b46eb6"}
Aug 04 11:33:35.514321 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.514302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"7e3df6edbcf1f0a7aafb800ade17795bd1e4f61a7af9817499767c6ddc9ebd14"}
Aug 04 11:33:35.514427 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.514374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"8b48fa6d03723a8a161f9973f4ac20c68896527bd70997bd56965d67e913461a"}
Aug 04 11:33:35.514496 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.514444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"3494c2a78027446f3f8a1a50b4fa38ba9a8112e705cb4eca1e5f26b7ee49e097"}
Aug 04 11:33:35.514551 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.514500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"8337190a390ce37b0254f3f9d189ce05ad98e58aa947bd5f9aa95ce454514952"}
Aug 04 11:33:35.514608 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.514550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"44a4801c504f28de48797532e88b2a34fc66f3cb2c67f5b6781fe28be0f22749"}
Aug 04 11:33:35.515669 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.515650    2582 generic.go:356] "Generic (PLEG): container finished" podID="97560ccf02a1820c065a7371bf3c35a7" containerID="3455bdb305bc7ab37812b021e56376e0d374189aee763e9915a7ba55bb7b53db" exitCode=0
Aug 04 11:33:35.515742 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.515730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"97560ccf02a1820c065a7371bf3c35a7","Type":"ContainerDied","Data":"3455bdb305bc7ab37812b021e56376e0d374189aee763e9915a7ba55bb7b53db"}
Aug 04 11:33:35.517456 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.517434    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm" event={"ID":"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783","Type":"ContainerStarted","Data":"2782e58fd7bd4b394bf35bce59db89c027c136d4cdb3e2c346c9c17cc938cff1"}
Aug 04 11:33:35.518758 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.518740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8wmgk" event={"ID":"ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb","Type":"ContainerStarted","Data":"6d3c4e8f2c8794be621146d707c77eab2fd8ef6c6bfda7e7a235ff91f72a8d8e"}
Aug 04 11:33:35.524568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.524527    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vt4n" podStartSLOduration=2.150881397 podStartE2EDuration="22.524512829s" totalImagesPullingTime="20.373631432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:35.524205265 +0000 UTC m=+23.698691267" watchObservedRunningTime="2026-08-04 11:33:35.524512829 +0000 UTC m=+23.698998830"
Aug 04 11:33:35.562490 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.562439    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v9lmc" podStartSLOduration=2.153339136 podStartE2EDuration="22.562418659s" totalImagesPullingTime="20.409079523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:35.562179656 +0000 UTC m=+23.736665671" watchObservedRunningTime="2026-08-04 11:33:35.562418659 +0000 UTC m=+23.736904653"
Aug 04 11:33:35.584336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.584166    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-97jv5" podStartSLOduration=2.178174228 podStartE2EDuration="22.584150427s" totalImagesPullingTime="20.405976199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:35.583819239 +0000 UTC m=+23.758305240" watchObservedRunningTime="2026-08-04 11:33:35.584150427 +0000 UTC m=+23.758636428"
Aug 04 11:33:35.617239 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:35.617193    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8wmgk" podStartSLOduration=2.254865102 podStartE2EDuration="22.617177058s" totalImagesPullingTime="20.362311956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:35.601004769 +0000 UTC m=+23.775490772" watchObservedRunningTime="2026-08-04 11:33:35.617177058 +0000 UTC m=+23.791663098"
Aug 04 11:33:36.344357 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:36.344331    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:36.347306 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:36.347253    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:36.433579 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:36.433540    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 11:33:36.523297 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:36.523259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"97560ccf02a1820c065a7371bf3c35a7","Type":"ContainerStarted","Data":"14cb630d6d26eed52ef83f199884d9097946a1b3c9ae10d486f9630a23b3e88b"}
Aug 04 11:33:36.525496 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:36.525441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm" event={"ID":"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783","Type":"ContainerStarted","Data":"ac34584fceb8fe962f71ce7b41ba9cd704a4559aefcac44528aa400219245316"}
Aug 04 11:33:36.540794 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:36.540756    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" podStartSLOduration=23.540742758 podStartE2EDuration="23.540742758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:36.540355429 +0000 UTC m=+24.714841430" watchObservedRunningTime="2026-08-04 11:33:36.540742758 +0000 UTC m=+24.715228762"
Aug 04 11:33:37.252577 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.251941    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T11:33:36.433563108Z","UUID":"41cb1836-66a7-400f-8313-3e4d53b6da16","Handler":null,"Name":"","Endpoint":""}
Aug 04 11:33:37.253937 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.253911    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 11:33:37.254060 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.253963    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 11:33:37.344007 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.343969    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:37.344192 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.343969    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:37.344192 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:37.344100    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:37.344192 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:37.344162    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:37.534194 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.534158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"11fb3484c64ada053c1fc829fe506af5ddf59285054842d6ab79b5b05083eccb"}
Aug 04 11:33:37.710306 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.710279    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:37.710865 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:37.710844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:38.343904 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:38.343865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:38.344111 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:38.344012    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:38.538637 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:38.538596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm" event={"ID":"c56c2e23-c8b2-4e8c-9edf-036f1bf8f783","Type":"ContainerStarted","Data":"6603f0be8d6e456e83ef1c45acdcf02c82f64adf570134dd740b6eb07dce44e5"}
Aug 04 11:33:38.539121 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:38.538782    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:38.539288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:38.539264    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8wmgk"
Aug 04 11:33:38.556830 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:38.556773    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5lcm" podStartSLOduration=2.778408258 podStartE2EDuration="25.556754719s" totalImagesPullingTime="22.778346461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:38.556576855 +0000 UTC m=+26.731062858" watchObservedRunningTime="2026-08-04 11:33:38.556754719 +0000 UTC m=+26.731240762"
Aug 04 11:33:39.343615 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:39.343579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:39.343769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:39.343627    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:39.343769 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:39.343686    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:39.343854 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:39.343787    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:39.544713 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:39.544536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" event={"ID":"fd618792-a4bd-49be-bff5-163003816894","Type":"ContainerStarted","Data":"f93590f6e4ef50b387e0ec191ef8141cb3438aba8eea682b9c131fc2265c2b15"}
Aug 04 11:33:39.570210 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:39.570165    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj" podStartSLOduration=5.798687561 podStartE2EDuration="26.570150815s" totalImagesPullingTime="20.771463254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:39.569864924 +0000 UTC m=+27.744350927" watchObservedRunningTime="2026-08-04 11:33:39.570150815 +0000 UTC m=+27.744636817"
Aug 04 11:33:40.343727 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.343698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:40.343897 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:40.343820    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:40.548435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.548345    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a70985f-5b44-4320-abd9-7c1a7e076929" containerID="1d50e98a100fae79e65657b759c05b9e02565928068698ae8a2f8f4912150d3d" exitCode=0
Aug 04 11:33:40.549016 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.548440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerDied","Data":"1d50e98a100fae79e65657b759c05b9e02565928068698ae8a2f8f4912150d3d"}
Aug 04 11:33:40.549016 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.548644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:40.549016 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.548945    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:40.549016 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.548999    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:40.564077 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.564056    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:40.564188 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:40.564152    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:33:41.344011 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.343825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:41.344210 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.343880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:41.344210 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:41.344088    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:41.344210 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:41.344183    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:41.400877 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.400848    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-chq84"]
Aug 04 11:33:41.401502 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.401479    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-745xn"]
Aug 04 11:33:41.401618 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.401575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:41.401673 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:41.401657    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:41.403164 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.403140    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qcg9t"]
Aug 04 11:33:41.550140 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.550120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:41.550485 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:41.550125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:41.550485 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:41.550220    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:41.550485 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:41.550304    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:42.554020 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:42.553987    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a70985f-5b44-4320-abd9-7c1a7e076929" containerID="51cf45f1fb5769273f3909ef499a7e44ca4dc7f0d1b0cef4cbb5feea5efe1acf" exitCode=0
Aug 04 11:33:42.554423 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:42.554074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerDied","Data":"51cf45f1fb5769273f3909ef499a7e44ca4dc7f0d1b0cef4cbb5feea5efe1acf"}
Aug 04 11:33:43.343442 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:43.343396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:43.343637 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:43.343451    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:43.343637 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:43.343451    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:43.343637 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:43.343527    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:43.343637 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:43.343614    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:43.343827 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:43.343683    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:44.560030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:44.560000    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a70985f-5b44-4320-abd9-7c1a7e076929" containerID="b47c898569ddd0bd5d05e195768707ed3c682e0422663fc9420b8e234b2b3de0" exitCode=0
Aug 04 11:33:44.560391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:44.560045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerDied","Data":"b47c898569ddd0bd5d05e195768707ed3c682e0422663fc9420b8e234b2b3de0"}
Aug 04 11:33:45.039498 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:45.039459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:45.039498 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:45.039501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:45.039710 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.039611    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:45.039710 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.039620    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:45.039710 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.039687    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs podName:993330bc-f4b7-44db-98b6-78c8112c525e nodeName:}" failed. No retries permitted until 2026-08-04 11:34:17.039667765 +0000 UTC m=+65.214153749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs") pod "network-metrics-daemon-745xn" (UID: "993330bc-f4b7-44db-98b6-78c8112c525e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 11:33:45.039710 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.039705    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret podName:254d88f0-4553-4400-83e1-9210c23a98a7 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:17.039695778 +0000 UTC m=+65.214181775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret") pod "global-pull-secret-syncer-chq84" (UID: "254d88f0-4553-4400-83e1-9210c23a98a7") : object "kube-system"/"original-pull-secret" not registered
Aug 04 11:33:45.140687 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:45.140650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:45.140880 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.140835    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 11:33:45.140880 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.140860    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 11:33:45.140880 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.140872    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pzd92 for pod openshift-network-diagnostics/network-check-target-qcg9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:45.141038 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.140941    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92 podName:fcd9cfec-c91a-4b97-babc-fb728550946a nodeName:}" failed. No retries permitted until 2026-08-04 11:34:17.140920815 +0000 UTC m=+65.315406811 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pzd92" (UniqueName: "kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92") pod "network-check-target-qcg9t" (UID: "fcd9cfec-c91a-4b97-babc-fb728550946a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 11:33:45.343642 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:45.343567    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:45.343794 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:45.343567    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:45.343794 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.343686    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chq84" podUID="254d88f0-4553-4400-83e1-9210c23a98a7"
Aug 04 11:33:45.343880 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.343813    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-745xn" podUID="993330bc-f4b7-44db-98b6-78c8112c525e"
Aug 04 11:33:45.343880 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:45.343571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:45.343970 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:45.343930    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcg9t" podUID="fcd9cfec-c91a-4b97-babc-fb728550946a"
Aug 04 11:33:47.184536 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.184305    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeReady"
Aug 04 11:33:47.184960 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.184677    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 11:33:47.243664 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.243433    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b2pq4"]
Aug 04 11:33:47.245646 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.245619    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.249185 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.248966    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 11:33:47.249185 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.249003    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hll8p\""
Aug 04 11:33:47.249185 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.249050    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 11:33:47.250014 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.249760    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dwq74"]
Aug 04 11:33:47.251575 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.251555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.254504 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.254035    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 11:33:47.254893 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.254874    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tcjzq\""
Aug 04 11:33:47.254985 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.254900    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 11:33:47.255123 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.255108    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 11:33:47.266970 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.266946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b2pq4"]
Aug 04 11:33:47.267730 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.267679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dwq74"]
Aug 04 11:33:47.343958 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.343914    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:33:47.343958 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.343944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:33:47.344197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.343938    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:33:47.346557 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.346390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 11:33:47.346557 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.346482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 11:33:47.346557 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.346507    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rm6g\""
Aug 04 11:33:47.346817 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.346719    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 11:33:47.346817 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.346761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zp2md\""
Aug 04 11:33:47.346817 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.346812    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 11:33:47.356486 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.356464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jkc\" (UniqueName: \"kubernetes.io/projected/2d64f48b-19e4-4b51-a4be-f04c5291889c-kube-api-access-q8jkc\") pod \"ingress-canary-dwq74\" (UID: \"2d64f48b-19e4-4b51-a4be-f04c5291889c\") " pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.356607 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.356497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.356607 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.356524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d64f48b-19e4-4b51-a4be-f04c5291889c-cert\") pod \"ingress-canary-dwq74\" (UID: \"2d64f48b-19e4-4b51-a4be-f04c5291889c\") " pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.356607 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.356548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c604be-32e1-4b7c-9416-47c671fb1fe7-tmp-dir\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.356607 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.356597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxr9b\" (UniqueName: \"kubernetes.io/projected/43c604be-32e1-4b7c-9416-47c671fb1fe7-kube-api-access-bxr9b\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.356807 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.356666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43c604be-32e1-4b7c-9416-47c671fb1fe7-config-volume\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.457759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.457670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jkc\" (UniqueName: \"kubernetes.io/projected/2d64f48b-19e4-4b51-a4be-f04c5291889c-kube-api-access-q8jkc\") pod \"ingress-canary-dwq74\" (UID: \"2d64f48b-19e4-4b51-a4be-f04c5291889c\") " pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.457759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.457712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.457759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.457739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d64f48b-19e4-4b51-a4be-f04c5291889c-cert\") pod \"ingress-canary-dwq74\" (UID: \"2d64f48b-19e4-4b51-a4be-f04c5291889c\") " pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.457759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.457761    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c604be-32e1-4b7c-9416-47c671fb1fe7-tmp-dir\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.458080 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.457858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxr9b\" (UniqueName: \"kubernetes.io/projected/43c604be-32e1-4b7c-9416-47c671fb1fe7-kube-api-access-bxr9b\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.458080 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.457893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43c604be-32e1-4b7c-9416-47c671fb1fe7-config-volume\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.458265 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:47.457860    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 11:33:47.458333 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:47.458313    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls podName:43c604be-32e1-4b7c-9416-47c671fb1fe7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:47.958291679 +0000 UTC m=+36.132777674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls") pod "dns-default-b2pq4" (UID: "43c604be-32e1-4b7c-9416-47c671fb1fe7") : secret "dns-default-metrics-tls" not found
Aug 04 11:33:47.458582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.458561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c604be-32e1-4b7c-9416-47c671fb1fe7-tmp-dir\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.458697 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.458669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43c604be-32e1-4b7c-9416-47c671fb1fe7-config-volume\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.462542 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.462521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d64f48b-19e4-4b51-a4be-f04c5291889c-cert\") pod \"ingress-canary-dwq74\" (UID: \"2d64f48b-19e4-4b51-a4be-f04c5291889c\") " pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.469773 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.469745    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxr9b\" (UniqueName: \"kubernetes.io/projected/43c604be-32e1-4b7c-9416-47c671fb1fe7-kube-api-access-bxr9b\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.469951 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.469926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jkc\" (UniqueName: \"kubernetes.io/projected/2d64f48b-19e4-4b51-a4be-f04c5291889c-kube-api-access-q8jkc\") pod \"ingress-canary-dwq74\" (UID: \"2d64f48b-19e4-4b51-a4be-f04c5291889c\") " pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.564915 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.564877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwq74"
Aug 04 11:33:47.961389 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:47.961344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:47.961571 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:47.961517    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 11:33:47.961646 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:47.961600    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls podName:43c604be-32e1-4b7c-9416-47c671fb1fe7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:48.961575216 +0000 UTC m=+37.136061202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls") pod "dns-default-b2pq4" (UID: "43c604be-32e1-4b7c-9416-47c671fb1fe7") : secret "dns-default-metrics-tls" not found
Aug 04 11:33:48.535908 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:48.535884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dwq74"]
Aug 04 11:33:48.539477 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:48.539451    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d64f48b_19e4_4b51_a4be_f04c5291889c.slice/crio-8f3e02d0e8b261bf208eef38f62500b38cf1764527072631570b3eb874003fc5 WatchSource:0}: Error finding container 8f3e02d0e8b261bf208eef38f62500b38cf1764527072631570b3eb874003fc5: Status 404 returned error can't find the container with id 8f3e02d0e8b261bf208eef38f62500b38cf1764527072631570b3eb874003fc5
Aug 04 11:33:48.573344 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:48.573315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerStarted","Data":"46947ca8734b2954a6c92ab829cf2ed4584d2f8171f684d83b45182b4d612b77"}
Aug 04 11:33:48.574557 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:48.574529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dwq74" event={"ID":"2d64f48b-19e4-4b51-a4be-f04c5291889c","Type":"ContainerStarted","Data":"8f3e02d0e8b261bf208eef38f62500b38cf1764527072631570b3eb874003fc5"}
Aug 04 11:33:48.969913 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:48.969869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:48.970063 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:48.969993    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 11:33:48.970106 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:48.970077    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls podName:43c604be-32e1-4b7c-9416-47c671fb1fe7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:50.970056502 +0000 UTC m=+39.144542486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls") pod "dns-default-b2pq4" (UID: "43c604be-32e1-4b7c-9416-47c671fb1fe7") : secret "dns-default-metrics-tls" not found
Aug 04 11:33:49.579547 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:49.579509    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a70985f-5b44-4320-abd9-7c1a7e076929" containerID="46947ca8734b2954a6c92ab829cf2ed4584d2f8171f684d83b45182b4d612b77" exitCode=0
Aug 04 11:33:49.579923 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:49.579572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerDied","Data":"46947ca8734b2954a6c92ab829cf2ed4584d2f8171f684d83b45182b4d612b77"}
Aug 04 11:33:50.584508 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:50.584323    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a70985f-5b44-4320-abd9-7c1a7e076929" containerID="69981143d0a0a9e2701d50e51b92a68ef8cb7fcec782644de1a2303e08e5500c" exitCode=0
Aug 04 11:33:50.584508 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:50.584397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerDied","Data":"69981143d0a0a9e2701d50e51b92a68ef8cb7fcec782644de1a2303e08e5500c"}
Aug 04 11:33:50.985115 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:50.985083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:50.985232 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:50.985190    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 11:33:50.985267 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:50.985242    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls podName:43c604be-32e1-4b7c-9416-47c671fb1fe7 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:54.985228312 +0000 UTC m=+43.159714293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls") pod "dns-default-b2pq4" (UID: "43c604be-32e1-4b7c-9416-47c671fb1fe7") : secret "dns-default-metrics-tls" not found
Aug 04 11:33:51.590369 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:51.590335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" event={"ID":"5a70985f-5b44-4320-abd9-7c1a7e076929","Type":"ContainerStarted","Data":"db118385c7751efc5f583abd0bdb74589ccc5624a2aca8f95583b3e99fe12614"}
Aug 04 11:33:51.591724 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:51.591699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dwq74" event={"ID":"2d64f48b-19e4-4b51-a4be-f04c5291889c","Type":"ContainerStarted","Data":"59cefa43327b272f5a4fd2180fac5a8cac4fb5d96fde33be0966a05bb33e7844"}
Aug 04 11:33:51.613958 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:51.613914    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w4d9c" podStartSLOduration=8.390913163 podStartE2EDuration="38.613896741s" totalImagesPullingTime="30.222983578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:51.613751819 +0000 UTC m=+39.788237853" watchObservedRunningTime="2026-08-04 11:33:51.613896741 +0000 UTC m=+39.788382747"
Aug 04 11:33:51.627906 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:51.627863    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dwq74" podStartSLOduration=2.487425615 podStartE2EDuration="4.627853701s" totalImagesPullingTime="2.140428086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:51.627522213 +0000 UTC m=+39.802008215" watchObservedRunningTime="2026-08-04 11:33:51.627853701 +0000 UTC m=+39.802339703"
Aug 04 11:33:52.912612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.912578    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q8jkf"]
Aug 04 11:33:52.933982 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.933948    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8jkf"]
Aug 04 11:33:52.934112 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.934064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:52.936165 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.936139    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 11:33:52.936165 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.936142    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 11:33:52.936336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.936139    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 11:33:52.936336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.936182    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqqnm\""
Aug 04 11:33:52.936336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:52.936142    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 11:33:53.099263 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.099223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.099444 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.099290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01e07480-1580-44e0-9d74-67f2f47ad017-crio-socket\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.099444 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.099348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkmfs\" (UniqueName: \"kubernetes.io/projected/01e07480-1580-44e0-9d74-67f2f47ad017-kube-api-access-fkmfs\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.099444 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.099387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e07480-1580-44e0-9d74-67f2f47ad017-data-volume\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.099571 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.099450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.200827 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.200743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.200954 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.200893    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:53.200954 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.200898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.201030 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.200957    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:53.700937834 +0000 UTC m=+41.875423819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:53.201030 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.200983    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 11:33:53.201030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.200997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01e07480-1580-44e0-9d74-67f2f47ad017-crio-socket\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.201030 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.201030    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:53.701018056 +0000 UTC m=+41.875504055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : configmap "kube-rbac-proxy" not found
Aug 04 11:33:53.201192 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.201064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkmfs\" (UniqueName: \"kubernetes.io/projected/01e07480-1580-44e0-9d74-67f2f47ad017-kube-api-access-fkmfs\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.201192 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.201097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e07480-1580-44e0-9d74-67f2f47ad017-data-volume\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.201284 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.201185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01e07480-1580-44e0-9d74-67f2f47ad017-crio-socket\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.201437 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.201400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e07480-1580-44e0-9d74-67f2f47ad017-data-volume\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.211697 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.211681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkmfs\" (UniqueName: \"kubernetes.io/projected/01e07480-1580-44e0-9d74-67f2f47ad017-kube-api-access-fkmfs\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.704423 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.704365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.704614 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:53.704479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:53.704614 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.704479    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 11:33:53.704614 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.704536    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:53.704614 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.704555    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:54.704540052 +0000 UTC m=+42.879026032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : configmap "kube-rbac-proxy" not found
Aug 04 11:33:53.704614 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:53.704599    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:54.704584832 +0000 UTC m=+42.879070815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:54.141398 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.141360    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"]
Aug 04 11:33:54.171120 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.171091    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"]
Aug 04 11:33:54.171268 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.171189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"
Aug 04 11:33:54.173120 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.173098    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-992rl\""
Aug 04 11:33:54.173120 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.173100    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 11:33:54.173549 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.173533    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 11:33:54.308582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.308542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfrgn\" (UniqueName: \"kubernetes.io/projected/133adc69-b693-4757-b2cb-39f5679ffde3-kube-api-access-cfrgn\") pod \"migrator-68bc745d87-fj2np\" (UID: \"133adc69-b693-4757-b2cb-39f5679ffde3\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"
Aug 04 11:33:54.409797 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.409706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfrgn\" (UniqueName: \"kubernetes.io/projected/133adc69-b693-4757-b2cb-39f5679ffde3-kube-api-access-cfrgn\") pod \"migrator-68bc745d87-fj2np\" (UID: \"133adc69-b693-4757-b2cb-39f5679ffde3\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"
Aug 04 11:33:54.417504 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.417475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfrgn\" (UniqueName: \"kubernetes.io/projected/133adc69-b693-4757-b2cb-39f5679ffde3-kube-api-access-cfrgn\") pod \"migrator-68bc745d87-fj2np\" (UID: \"133adc69-b693-4757-b2cb-39f5679ffde3\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"
Aug 04 11:33:54.479649 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.479614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"
Aug 04 11:33:54.615720 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.615640    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np"]
Aug 04 11:33:54.618749 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:54.618720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133adc69_b693_4757_b2cb_39f5679ffde3.slice/crio-e41e6de87afca3c12c69b0364e083b67abf0e206f42002bdbc911190f9a1b364 WatchSource:0}: Error finding container e41e6de87afca3c12c69b0364e083b67abf0e206f42002bdbc911190f9a1b364: Status 404 returned error can't find the container with id e41e6de87afca3c12c69b0364e083b67abf0e206f42002bdbc911190f9a1b364
Aug 04 11:33:54.712776 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.712690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:54.712776 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:54.712763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:54.712959 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:54.712869    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:54.712959 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:54.712921    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 11:33:54.713032 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:54.712934    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:56.712916368 +0000 UTC m=+44.887402354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:54.713032 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:54.712988    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:33:56.712973527 +0000 UTC m=+44.887459510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : configmap "kube-rbac-proxy" not found
Aug 04 11:33:55.014568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.014468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:33:55.014708 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:55.014617    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 11:33:55.014708 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:55.014694    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls podName:43c604be-32e1-4b7c-9416-47c671fb1fe7 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:03.014669418 +0000 UTC m=+51.189155399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls") pod "dns-default-b2pq4" (UID: "43c604be-32e1-4b7c-9416-47c671fb1fe7") : secret "dns-default-metrics-tls" not found
Aug 04 11:33:55.075342 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.075319    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9lmc_83545514-c89f-4911-a801-7baebbb9d89e/dns-node-resolver/0.log"
Aug 04 11:33:55.603206 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.603158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np" event={"ID":"133adc69-b693-4757-b2cb-39f5679ffde3","Type":"ContainerStarted","Data":"e41e6de87afca3c12c69b0364e083b67abf0e206f42002bdbc911190f9a1b364"}
Aug 04 11:33:55.717272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.717235    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-xg4w7"]
Aug 04 11:33:55.738672 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.738642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-xg4w7"]
Aug 04 11:33:55.738832 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.738748    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.740878 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.740856    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 04 11:33:55.741125 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.741088    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 04 11:33:55.741452 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.741434    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 04 11:33:55.741452 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.741445    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 04 11:33:55.741606 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.741436    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gnp76\""
Aug 04 11:33:55.821366 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.821330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-signing-cabundle\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.821561 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.821471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-signing-key\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.821561 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.821500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvkg\" (UniqueName: \"kubernetes.io/projected/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-kube-api-access-rjvkg\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.875331 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.875264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97jv5_48a31f1f-bc82-4402-86b6-26de7ba1d6de/node-ca/0.log"
Aug 04 11:33:55.922646 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.922602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-signing-key\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.922646 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.922649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvkg\" (UniqueName: \"kubernetes.io/projected/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-kube-api-access-rjvkg\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.922921 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.922697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-signing-cabundle\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.923575 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.923549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-signing-cabundle\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.925669 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.925632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-signing-key\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:55.931219 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:55.931189    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvkg\" (UniqueName: \"kubernetes.io/projected/62dda27f-32f6-4714-a2fe-972fc7f0a4b8-kube-api-access-rjvkg\") pod \"service-ca-98c88fbb5-xg4w7\" (UID: \"62dda27f-32f6-4714-a2fe-972fc7f0a4b8\") " pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:56.047597 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.047558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7"
Aug 04 11:33:56.178337 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.178301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-xg4w7"]
Aug 04 11:33:56.321552 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:33:56.321522    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62dda27f_32f6_4714_a2fe_972fc7f0a4b8.slice/crio-a0a33ae89aeb25105c8311f40dfd97b985e71ecd0e9cd9bb47c757ddb2df1435 WatchSource:0}: Error finding container a0a33ae89aeb25105c8311f40dfd97b985e71ecd0e9cd9bb47c757ddb2df1435: Status 404 returned error can't find the container with id a0a33ae89aeb25105c8311f40dfd97b985e71ecd0e9cd9bb47c757ddb2df1435
Aug 04 11:33:56.606880 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.606840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np" event={"ID":"133adc69-b693-4757-b2cb-39f5679ffde3","Type":"ContainerStarted","Data":"9e462281498369218d1b40d1dd403666168e6f122a031b83a1019a0d27d51568"}
Aug 04 11:33:56.607293 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.606901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np" event={"ID":"133adc69-b693-4757-b2cb-39f5679ffde3","Type":"ContainerStarted","Data":"13198d6c03b07f5e114103d88792ac8b0187e55cbf93b3b0777c18182390f4d1"}
Aug 04 11:33:56.607979 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.607957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7" event={"ID":"62dda27f-32f6-4714-a2fe-972fc7f0a4b8","Type":"ContainerStarted","Data":"a0a33ae89aeb25105c8311f40dfd97b985e71ecd0e9cd9bb47c757ddb2df1435"}
Aug 04 11:33:56.624102 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.624054    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-fj2np" podStartSLOduration=0.89844631 podStartE2EDuration="2.624038458s" totalImagesPullingTime="1.725592148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:56.623557745 +0000 UTC m=+44.798043748" watchObservedRunningTime="2026-08-04 11:33:56.624038458 +0000 UTC m=+44.798524460"
Aug 04 11:33:56.730711 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.730621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:56.730858 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.730703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:33:56.730858 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:56.730766    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 11:33:56.730858 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:56.730837    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:00.730821382 +0000 UTC m=+48.905307363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : configmap "kube-rbac-proxy" not found
Aug 04 11:33:56.730858 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:56.730851    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:56.731022 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:33:56.730903    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:00.730888533 +0000 UTC m=+48.905374517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : secret "insights-runtime-extractor-tls" not found
Aug 04 11:33:56.876384 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:56.876334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dwq74_2d64f48b-19e4-4b51-a4be-f04c5291889c/serve-healthcheck-canary/0.log"
Aug 04 11:33:59.616899 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:59.616859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7" event={"ID":"62dda27f-32f6-4714-a2fe-972fc7f0a4b8","Type":"ContainerStarted","Data":"840c47c83d195245eca734dfd5392a946a4d13fc211a2c1a0296a111c4e65015"}
Aug 04 11:33:59.632555 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:33:59.632499    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-xg4w7" podStartSLOduration=2.37709645 podStartE2EDuration="4.632484017s" totalImagesPullingTime="2.255387567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:59.632331482 +0000 UTC m=+47.806817483" watchObservedRunningTime="2026-08-04 11:33:59.632484017 +0000 UTC m=+47.806970018"
Aug 04 11:34:00.766234 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:00.766187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:34:00.766748 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:34:00.766345    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 11:34:00.766748 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:00.766381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:34:00.766748 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:34:00.766440    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls podName:01e07480-1580-44e0-9d74-67f2f47ad017 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:08.76642077 +0000 UTC m=+56.940906754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8jkf" (UID: "01e07480-1580-44e0-9d74-67f2f47ad017") : secret "insights-runtime-extractor-tls" not found
Aug 04 11:34:00.767008 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:00.766986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e07480-1580-44e0-9d74-67f2f47ad017-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:34:03.083769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:03.083734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:34:03.084162 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:34:03.083861    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 11:34:03.084162 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:34:03.083915    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls podName:43c604be-32e1-4b7c-9416-47c671fb1fe7 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:19.083900411 +0000 UTC m=+67.258386392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls") pod "dns-default-b2pq4" (UID: "43c604be-32e1-4b7c-9416-47c671fb1fe7") : secret "dns-default-metrics-tls" not found
Aug 04 11:34:08.826344 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:08.826307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:34:08.828619 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:08.828599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e07480-1580-44e0-9d74-67f2f47ad017-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8jkf\" (UID: \"01e07480-1580-44e0-9d74-67f2f47ad017\") " pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:34:08.842523 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:08.842491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8jkf"
Aug 04 11:34:08.970489 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:08.970456    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8jkf"]
Aug 04 11:34:08.974348 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:08.974314    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e07480_1580_44e0_9d74_67f2f47ad017.slice/crio-012734b102ef54a0fcd25d93f8199980ab372d5b5100a2664d03195faeeb049d WatchSource:0}: Error finding container 012734b102ef54a0fcd25d93f8199980ab372d5b5100a2664d03195faeeb049d: Status 404 returned error can't find the container with id 012734b102ef54a0fcd25d93f8199980ab372d5b5100a2664d03195faeeb049d
Aug 04 11:34:09.643100 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:09.643072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8jkf" event={"ID":"01e07480-1580-44e0-9d74-67f2f47ad017","Type":"ContainerStarted","Data":"6140b610b227d7365b1b6d773db0cacaf01aed31ac10fb1f42ac3ba36dfcb7a3"}
Aug 04 11:34:09.643207 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:09.643148    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8jkf" event={"ID":"01e07480-1580-44e0-9d74-67f2f47ad017","Type":"ContainerStarted","Data":"012734b102ef54a0fcd25d93f8199980ab372d5b5100a2664d03195faeeb049d"}
Aug 04 11:34:10.649455 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:10.649400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8jkf" event={"ID":"01e07480-1580-44e0-9d74-67f2f47ad017","Type":"ContainerStarted","Data":"aaad385981f89a05712b59b694bc765a765c753c6e649c34ebc012ccdd20cd4d"}
Aug 04 11:34:11.654147 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:11.654111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8jkf" event={"ID":"01e07480-1580-44e0-9d74-67f2f47ad017","Type":"ContainerStarted","Data":"a54f8f866c6da64da38b38bfeca1b4e86c8a625145bb53f3ded1359b6febf7c4"}
Aug 04 11:34:11.672338 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:11.672291    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q8jkf" podStartSLOduration=17.83813077 podStartE2EDuration="19.672276948s" totalImagesPullingTime="1.834146178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:11.671805726 +0000 UTC m=+59.846291727" watchObservedRunningTime="2026-08-04 11:34:11.672276948 +0000 UTC m=+59.846762949"
Aug 04 11:34:12.569580 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:12.569549    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-slfmj"
Aug 04 11:34:14.547143 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.547113    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"]
Aug 04 11:34:14.551929 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.551896    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.553838 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.553817    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 11:34:14.553838 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.553833    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 11:34:14.554097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.554081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 11:34:14.554743 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.554721    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 11:34:14.554743 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.554741    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 11:34:14.554901 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.554722    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 11:34:14.554901 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.554757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 11:34:14.572851 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.572827    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"]
Aug 04 11:34:14.666840 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.666807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-ca\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.666987 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.666851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.666987 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.666900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13bee8e-5b62-4422-96a9-0d5d07504134-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.666987 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.666922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6z9\" (UniqueName: \"kubernetes.io/projected/c13bee8e-5b62-4422-96a9-0d5d07504134-kube-api-access-6v6z9\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.666987 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.666968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-hub\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.667116 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.666992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.767399 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.767366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13bee8e-5b62-4422-96a9-0d5d07504134-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.767399 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.767398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6z9\" (UniqueName: \"kubernetes.io/projected/c13bee8e-5b62-4422-96a9-0d5d07504134-kube-api-access-6v6z9\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.767668 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.767433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-hub\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.767668 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.767493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.767668 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.767617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-ca\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.767668 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.767660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.768365 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.768340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13bee8e-5b62-4422-96a9-0d5d07504134-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.769925 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.769903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.770038 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.769957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-ca\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.770038 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.769970    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.770038 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.770011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c13bee8e-5b62-4422-96a9-0d5d07504134-hub\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.782548 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.782527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6z9\" (UniqueName: \"kubernetes.io/projected/c13bee8e-5b62-4422-96a9-0d5d07504134-kube-api-access-6v6z9\") pod \"cluster-proxy-proxy-agent-6466c76bdb-gf94x\" (UID: \"c13bee8e-5b62-4422-96a9-0d5d07504134\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:14.879692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:14.879665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"
Aug 04 11:34:15.001916 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:15.001856    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x"]
Aug 04 11:34:15.004880 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:15.004852    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc13bee8e_5b62_4422_96a9_0d5d07504134.slice/crio-f671ab4957dbcdca02bb60784573bf16e2b9a4179612791130b539b8ffa7571e WatchSource:0}: Error finding container f671ab4957dbcdca02bb60784573bf16e2b9a4179612791130b539b8ffa7571e: Status 404 returned error can't find the container with id f671ab4957dbcdca02bb60784573bf16e2b9a4179612791130b539b8ffa7571e
Aug 04 11:34:15.666939 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:15.666903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x" event={"ID":"c13bee8e-5b62-4422-96a9-0d5d07504134","Type":"ContainerStarted","Data":"f671ab4957dbcdca02bb60784573bf16e2b9a4179612791130b539b8ffa7571e"}
Aug 04 11:34:17.083733 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.083695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:34:17.084211 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.083800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:34:17.086160 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.086131    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 11:34:17.086292 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.086131    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 11:34:17.097048 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.097021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/993330bc-f4b7-44db-98b6-78c8112c525e-metrics-certs\") pod \"network-metrics-daemon-745xn\" (UID: \"993330bc-f4b7-44db-98b6-78c8112c525e\") " pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:34:17.097499 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.097452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/254d88f0-4553-4400-83e1-9210c23a98a7-original-pull-secret\") pod \"global-pull-secret-syncer-chq84\" (UID: \"254d88f0-4553-4400-83e1-9210c23a98a7\") " pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:34:17.184850 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.184795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:34:17.187539 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.187513    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 11:34:17.197207 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.197181    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 11:34:17.208807 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.208782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd92\" (UniqueName: \"kubernetes.io/projected/fcd9cfec-c91a-4b97-babc-fb728550946a-kube-api-access-pzd92\") pod \"network-check-target-qcg9t\" (UID: \"fcd9cfec-c91a-4b97-babc-fb728550946a\") " pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:34:17.358566 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.358533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rm6g\""
Aug 04 11:34:17.366047 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.366022    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-745xn"
Aug 04 11:34:17.367216 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.367176    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zp2md\""
Aug 04 11:34:17.369577 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.369524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chq84"
Aug 04 11:34:17.375304 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:17.375282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:34:18.230745 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:18.230671    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-chq84"]
Aug 04 11:34:18.235918 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:18.235887    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254d88f0_4553_4400_83e1_9210c23a98a7.slice/crio-00cdee246773a4cae5be6febb4186453a2c9fa9656f4c8eb5bdb046f3eb5f884 WatchSource:0}: Error finding container 00cdee246773a4cae5be6febb4186453a2c9fa9656f4c8eb5bdb046f3eb5f884: Status 404 returned error can't find the container with id 00cdee246773a4cae5be6febb4186453a2c9fa9656f4c8eb5bdb046f3eb5f884
Aug 04 11:34:18.461974 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:18.461931    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qcg9t"]
Aug 04 11:34:18.463067 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:18.463046    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-745xn"]
Aug 04 11:34:18.679863 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:18.679830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-chq84" event={"ID":"254d88f0-4553-4400-83e1-9210c23a98a7","Type":"ContainerStarted","Data":"00cdee246773a4cae5be6febb4186453a2c9fa9656f4c8eb5bdb046f3eb5f884"}
Aug 04 11:34:19.098333 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.098295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:34:19.101151 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.101124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43c604be-32e1-4b7c-9416-47c671fb1fe7-metrics-tls\") pod \"dns-default-b2pq4\" (UID: \"43c604be-32e1-4b7c-9416-47c671fb1fe7\") " pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:34:19.359890 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.359816    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hll8p\""
Aug 04 11:34:19.368724 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.368688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:34:19.472224 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:19.472191    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd9cfec_c91a_4b97_babc_fb728550946a.slice/crio-9df8c3718ab6767eaf58551251503871e1653ee25ba5bd5e27c3c6a9a8c7cc95 WatchSource:0}: Error finding container 9df8c3718ab6767eaf58551251503871e1653ee25ba5bd5e27c3c6a9a8c7cc95: Status 404 returned error can't find the container with id 9df8c3718ab6767eaf58551251503871e1653ee25ba5bd5e27c3c6a9a8c7cc95
Aug 04 11:34:19.472707 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:19.472682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993330bc_f4b7_44db_98b6_78c8112c525e.slice/crio-a3108d81cf1903d5eb669ff878622d17af9d26a8f45eaa346aad7a62ab09dfd1 WatchSource:0}: Error finding container a3108d81cf1903d5eb669ff878622d17af9d26a8f45eaa346aad7a62ab09dfd1: Status 404 returned error can't find the container with id a3108d81cf1903d5eb669ff878622d17af9d26a8f45eaa346aad7a62ab09dfd1
Aug 04 11:34:19.612078 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.612008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b2pq4"]
Aug 04 11:34:19.683691 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.683653    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qcg9t" event={"ID":"fcd9cfec-c91a-4b97-babc-fb728550946a","Type":"ContainerStarted","Data":"9df8c3718ab6767eaf58551251503871e1653ee25ba5bd5e27c3c6a9a8c7cc95"}
Aug 04 11:34:19.684676 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:19.684651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-745xn" event={"ID":"993330bc-f4b7-44db-98b6-78c8112c525e","Type":"ContainerStarted","Data":"a3108d81cf1903d5eb669ff878622d17af9d26a8f45eaa346aad7a62ab09dfd1"}
Aug 04 11:34:19.756440 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:19.756390    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c604be_32e1_4b7c_9416_47c671fb1fe7.slice/crio-cf1c046b9545225db446519e53d7b528bf66288de723ead64af00f3783daf6ff WatchSource:0}: Error finding container cf1c046b9545225db446519e53d7b528bf66288de723ead64af00f3783daf6ff: Status 404 returned error can't find the container with id cf1c046b9545225db446519e53d7b528bf66288de723ead64af00f3783daf6ff
Aug 04 11:34:20.690853 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:20.690806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2pq4" event={"ID":"43c604be-32e1-4b7c-9416-47c671fb1fe7","Type":"ContainerStarted","Data":"cf1c046b9545225db446519e53d7b528bf66288de723ead64af00f3783daf6ff"}
Aug 04 11:34:20.695333 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:20.695299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x" event={"ID":"c13bee8e-5b62-4422-96a9-0d5d07504134","Type":"ContainerStarted","Data":"f70e5717648a34b08daedcf6a375f0234a0255eefae803623aed4ce6008c48ae"}
Aug 04 11:34:20.695522 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:20.695351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x" event={"ID":"c13bee8e-5b62-4422-96a9-0d5d07504134","Type":"ContainerStarted","Data":"f2e85af6f6503da9e3e5fdc45feee74d79aabf529e000edd6aa997b77d009e48"}
Aug 04 11:34:20.695522 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:20.695370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x" event={"ID":"c13bee8e-5b62-4422-96a9-0d5d07504134","Type":"ContainerStarted","Data":"653a03b1cb6dc09216771371635c306329ff092c5047c56c97130dbe8603dd2a"}
Aug 04 11:34:20.718888 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:20.718829    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6466c76bdb-gf94x" podStartSLOduration=1.934419035 podStartE2EDuration="6.718806781s" totalImagesPullingTime="4.784387746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:20.716894377 +0000 UTC m=+68.891380425" watchObservedRunningTime="2026-08-04 11:34:20.718806781 +0000 UTC m=+68.893292784"
Aug 04 11:34:24.712500 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.712455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-745xn" event={"ID":"993330bc-f4b7-44db-98b6-78c8112c525e","Type":"ContainerStarted","Data":"aeeb625689cf9d94ad5b5bfef1c57c8621b348d2ba46fc1f7e1c9791d86a9090"}
Aug 04 11:34:24.712925 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.712523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-745xn" event={"ID":"993330bc-f4b7-44db-98b6-78c8112c525e","Type":"ContainerStarted","Data":"1d72b607812f325e1857d9826668663d5ca8ea8569863263c6484344dc2329e5"}
Aug 04 11:34:24.714279 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.714254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2pq4" event={"ID":"43c604be-32e1-4b7c-9416-47c671fb1fe7","Type":"ContainerStarted","Data":"1c12fe974eef7082f383de11e0881bdbca87b6090543e55c35b2394e5ee89755"}
Aug 04 11:34:24.714391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.714293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2pq4" event={"ID":"43c604be-32e1-4b7c-9416-47c671fb1fe7","Type":"ContainerStarted","Data":"eaccb7a759d8c723cac92a88ed8d3931687776d5b800e863888b78e5cfdef4c4"}
Aug 04 11:34:24.714391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.714317    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:34:24.715642 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.715612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-chq84" event={"ID":"254d88f0-4553-4400-83e1-9210c23a98a7","Type":"ContainerStarted","Data":"34eaaedfc26231687f6426506451905845cdc7981d6ca9b9c21333f41c73ab2d"}
Aug 04 11:34:24.716953 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.716935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qcg9t" event={"ID":"fcd9cfec-c91a-4b97-babc-fb728550946a","Type":"ContainerStarted","Data":"8628456d3739d610093d0f4801b9ddb1db3aba3b733b61d31d3cdc3cfefb35d7"}
Aug 04 11:34:24.717055 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.717042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:34:24.728500 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.728459    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-745xn" podStartSLOduration=66.983526303 podStartE2EDuration="1m11.72844576s" totalImagesPullingTime="4.744919457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:24.727400842 +0000 UTC m=+72.901886844" watchObservedRunningTime="2026-08-04 11:34:24.72844576 +0000 UTC m=+72.902931797"
Aug 04 11:34:24.745987 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.745934    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b2pq4" podStartSLOduration=33.286764218 podStartE2EDuration="37.745918553s" totalImagesPullingTime="4.459154335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:24.744703571 +0000 UTC m=+72.919189575" watchObservedRunningTime="2026-08-04 11:34:24.745918553 +0000 UTC m=+72.920404556"
Aug 04 11:34:24.762091 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.762039    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qcg9t" podStartSLOduration=67.003823275 podStartE2EDuration="1m11.762020633s" totalImagesPullingTime="4.758197358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:24.761515958 +0000 UTC m=+72.936001964" watchObservedRunningTime="2026-08-04 11:34:24.762020633 +0000 UTC m=+72.936506635"
Aug 04 11:34:24.783990 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:24.783923    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-chq84" podStartSLOduration=65.779315182 podStartE2EDuration="1m11.783903463s" totalImagesPullingTime="6.004588281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:24.783506618 +0000 UTC m=+72.957992620" watchObservedRunningTime="2026-08-04 11:34:24.783903463 +0000 UTC m=+72.958389479"
Aug 04 11:34:30.220285 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.220246    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5cwpt"]
Aug 04 11:34:30.225455 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.225435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.227669 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.227645    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 11:34:30.227911 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.227896    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tqxrb\""
Aug 04 11:34:30.228072 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.228054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 11:34:30.228544 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.228336    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 11:34:30.228544 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.228416    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 11:34:30.228544 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.228442    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 11:34:30.228731 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.228634    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 11:34:30.269578 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-tls\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269703 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-accelerators-collector-config\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269703 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/659b3ef2-501c-4783-88b6-5f22afae8d39-metrics-client-ca\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269703 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-root\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269824 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-wtmp\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269824 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf7hm\" (UniqueName: \"kubernetes.io/projected/659b3ef2-501c-4783-88b6-5f22afae8d39-kube-api-access-rf7hm\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269824 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-textfile\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269936 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.269936 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.269855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-sys\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371194 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-tls\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-accelerators-collector-config\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/659b3ef2-501c-4783-88b6-5f22afae8d39-metrics-client-ca\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-root\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-wtmp\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf7hm\" (UniqueName: \"kubernetes.io/projected/659b3ef2-501c-4783-88b6-5f22afae8d39-kube-api-access-rf7hm\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-root\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-textfile\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-wtmp\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-sys\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/659b3ef2-501c-4783-88b6-5f22afae8d39-sys\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371930 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-textfile\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371930 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371863    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/659b3ef2-501c-4783-88b6-5f22afae8d39-metrics-client-ca\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.371930 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.371895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-accelerators-collector-config\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.373632 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.373611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-tls\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.373724 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.373683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/659b3ef2-501c-4783-88b6-5f22afae8d39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.380598 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.380573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf7hm\" (UniqueName: \"kubernetes.io/projected/659b3ef2-501c-4783-88b6-5f22afae8d39-kube-api-access-rf7hm\") pod \"node-exporter-5cwpt\" (UID: \"659b3ef2-501c-4783-88b6-5f22afae8d39\") " pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.537167 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.537088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5cwpt"
Aug 04 11:34:30.549067 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:30.549033    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659b3ef2_501c_4783_88b6_5f22afae8d39.slice/crio-72be8a1289c13d79eeacbe4d20d8b9ac1dd28f0ce52fb630cb5b5075239efa3e WatchSource:0}: Error finding container 72be8a1289c13d79eeacbe4d20d8b9ac1dd28f0ce52fb630cb5b5075239efa3e: Status 404 returned error can't find the container with id 72be8a1289c13d79eeacbe4d20d8b9ac1dd28f0ce52fb630cb5b5075239efa3e
Aug 04 11:34:30.738681 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:30.738640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cwpt" event={"ID":"659b3ef2-501c-4783-88b6-5f22afae8d39","Type":"ContainerStarted","Data":"72be8a1289c13d79eeacbe4d20d8b9ac1dd28f0ce52fb630cb5b5075239efa3e"}
Aug 04 11:34:31.244045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.243916    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:34:31.247868 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.247845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.250435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.250391    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 11:34:31.250657 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.250641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.251823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xtr7t\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.251938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.252091    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.252163    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.252175    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.252285    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 11:34:31.252495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.252392    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 11:34:31.252894 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.252877    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 11:34:31.265345 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.265322    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.277702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.277821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.277867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.277912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.277945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.277985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-out\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-web-config\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2j6s\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-kube-api-access-q2j6s\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.281612 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.278317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379292 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379292 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-out\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-web-config\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2j6s\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-kube-api-access-q2j6s\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.379616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.380100 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.380100 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.379944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.380208 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.380146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.380648 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:34:31.380342    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle podName:e7f54c84-69fd-43aa-a9d4-bba2d6f43b19 nodeName:}" failed. No retries permitted until 2026-08-04 11:34:31.880320606 +0000 UTC m=+80.054806610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19") : configmap references non-existent config key: ca-bundle.crt
Aug 04 11:34:31.382795 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.382766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.382955 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.382929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-out\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.383370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.383327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.384012 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.383978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.384088 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.384030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.384519 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.384485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.384828 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.384806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-web-config\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.385467 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.385445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.385970 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.385952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.388090 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.388061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2j6s\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-kube-api-access-q2j6s\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.743358 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.743322    2582 generic.go:356] "Generic (PLEG): container finished" podID="659b3ef2-501c-4783-88b6-5f22afae8d39" containerID="0908fec1276f49f9bf88d901cd6a86483d3ca562ba6108c1de1ad65951f2d8a5" exitCode=0
Aug 04 11:34:31.743519 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.743374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cwpt" event={"ID":"659b3ef2-501c-4783-88b6-5f22afae8d39","Type":"ContainerDied","Data":"0908fec1276f49f9bf88d901cd6a86483d3ca562ba6108c1de1ad65951f2d8a5"}
Aug 04 11:34:31.884602 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.884152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:31.884969 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:31.884948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:32.161174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:32.161147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:34:32.291090 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:32.291065    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:34:32.293306 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:32.293284    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f54c84_69fd_43aa_a9d4_bba2d6f43b19.slice/crio-66e3aebf563dc012113e7db8a41d251174d39c6b6f539c53488b247d2a7d65e3 WatchSource:0}: Error finding container 66e3aebf563dc012113e7db8a41d251174d39c6b6f539c53488b247d2a7d65e3: Status 404 returned error can't find the container with id 66e3aebf563dc012113e7db8a41d251174d39c6b6f539c53488b247d2a7d65e3
Aug 04 11:34:32.748871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:32.748831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cwpt" event={"ID":"659b3ef2-501c-4783-88b6-5f22afae8d39","Type":"ContainerStarted","Data":"52132dccdd9024aca70d13cbff172fe499d630eef44858012d892c0decbc032f"}
Aug 04 11:34:32.749025 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:32.748896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5cwpt" event={"ID":"659b3ef2-501c-4783-88b6-5f22afae8d39","Type":"ContainerStarted","Data":"60b7376bba943af36d2471b71f149783b24408ce8682ac7935a4acc2972396a4"}
Aug 04 11:34:32.749940 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:32.749917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"66e3aebf563dc012113e7db8a41d251174d39c6b6f539c53488b247d2a7d65e3"}
Aug 04 11:34:32.767372 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:32.767322    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5cwpt" podStartSLOduration=1.714920837 podStartE2EDuration="2.767307819s" totalImagesPullingTime="990.605053ms" totalInitContainerRuntime="61.781929ms" isStatefulPod=true podCreationTimestamp="2026-08-04 11:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:32.766028404 +0000 UTC m=+80.940514406" watchObservedRunningTime="2026-08-04 11:34:32.767307819 +0000 UTC m=+80.941793822"
Aug 04 11:34:33.754986 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:33.754900    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb" exitCode=0
Aug 04 11:34:33.755346 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:33.754983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb"}
Aug 04 11:34:34.723265 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:34.723140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b2pq4"
Aug 04 11:34:35.764470 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:35.764371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c"}
Aug 04 11:34:35.764470 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:35.764446    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7"}
Aug 04 11:34:35.764470 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:35.764472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf"}
Aug 04 11:34:35.764871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:35.764496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0"}
Aug 04 11:34:35.764871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:35.764519    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059"}
Aug 04 11:34:36.771814 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:36.771779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerStarted","Data":"b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4"}
Aug 04 11:34:36.802537 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:36.802481    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.36679635 podStartE2EDuration="5.802461476s" totalImagesPullingTime="3.415808963s" totalInitContainerRuntime="19.856163ms" isStatefulPod=false podCreationTimestamp="2026-08-04 11:34:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:36.801394688 +0000 UTC m=+84.975880690" watchObservedRunningTime="2026-08-04 11:34:36.802461476 +0000 UTC m=+84.976947479"
Aug 04 11:34:41.905002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.904961    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d45585f8-dtltr"]
Aug 04 11:34:41.909487 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.909462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.911689 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.911664    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 11:34:41.911822 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.911697    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 11:34:41.912034 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.912016    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 11:34:41.912129 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.912095    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 11:34:41.912287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.912263    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 11:34:41.912287 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.912277    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 11:34:41.912488 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.912263    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 11:34:41.912488 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.912296    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cj6dc\""
Aug 04 11:34:41.916181 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.916163    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 11:34:41.919176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.919080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d45585f8-dtltr"]
Aug 04 11:34:41.960486 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rttfg\" (UniqueName: \"kubernetes.io/projected/f00f0d99-0ba8-4563-b678-eeb0d8e44340-kube-api-access-rttfg\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.960486 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-config\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.960689 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-oauth-config\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.960689 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-serving-cert\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.960787 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-oauth-serving-cert\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.960787 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-service-ca\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:41.960787 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:41.960730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-trusted-ca-bundle\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.061779 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rttfg\" (UniqueName: \"kubernetes.io/projected/f00f0d99-0ba8-4563-b678-eeb0d8e44340-kube-api-access-rttfg\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.061779 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-config\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-oauth-config\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-serving-cert\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-oauth-serving-cert\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-service-ca\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.061899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-trusted-ca-bundle\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062652 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.062622    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-config\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.062671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-service-ca\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.062699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-oauth-serving-cert\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.062754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.062698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-trusted-ca-bundle\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.064929 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.064903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-oauth-config\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.065003 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.064992    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-serving-cert\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.070532 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.070510    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rttfg\" (UniqueName: \"kubernetes.io/projected/f00f0d99-0ba8-4563-b678-eeb0d8e44340-kube-api-access-rttfg\") pod \"console-d45585f8-dtltr\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") " pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.219714 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.219637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:42.348890 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.348872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d45585f8-dtltr"]
Aug 04 11:34:42.350300 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:34:42.350270    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00f0d99_0ba8_4563_b678_eeb0d8e44340.slice/crio-7d3a27f2c60a24de263641278cdbe3292bb943b56ad15f7df9478a8e4b014516 WatchSource:0}: Error finding container 7d3a27f2c60a24de263641278cdbe3292bb943b56ad15f7df9478a8e4b014516: Status 404 returned error can't find the container with id 7d3a27f2c60a24de263641278cdbe3292bb943b56ad15f7df9478a8e4b014516
Aug 04 11:34:42.794920 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:42.794879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45585f8-dtltr" event={"ID":"f00f0d99-0ba8-4563-b678-eeb0d8e44340","Type":"ContainerStarted","Data":"7d3a27f2c60a24de263641278cdbe3292bb943b56ad15f7df9478a8e4b014516"}
Aug 04 11:34:45.807372 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:45.807337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45585f8-dtltr" event={"ID":"f00f0d99-0ba8-4563-b678-eeb0d8e44340","Type":"ContainerStarted","Data":"8c88057cffd6b521a7608acb525c540e5c0047fa28e4aaca0eef380e8646820e"}
Aug 04 11:34:45.823350 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:45.823281    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d45585f8-dtltr" podStartSLOduration=1.905971993 podStartE2EDuration="4.823263921s" totalImagesPullingTime="2.917291928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:34:45.8229042 +0000 UTC m=+93.997390229" watchObservedRunningTime="2026-08-04 11:34:45.823263921 +0000 UTC m=+93.997749922"
Aug 04 11:34:52.220241 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:52.220204    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:52.220645 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:52.220282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:52.225124 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:52.225096    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:52.834749 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:52.834724    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:34:55.721963 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:34:55.721935    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qcg9t"
Aug 04 11:35:50.454864 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.454828    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:35:50.455388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.455120    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="alertmanager" containerID="cri-o://8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059" gracePeriod=120
Aug 04 11:35:50.455388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.455184    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-metric" containerID="cri-o://412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c" gracePeriod=120
Aug 04 11:35:50.455388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.455237    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="config-reloader" containerID="cri-o://931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0" gracePeriod=120
Aug 04 11:35:50.455388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.455222    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy" containerID="cri-o://e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7" gracePeriod=120
Aug 04 11:35:50.455388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.455269    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="prom-label-proxy" containerID="cri-o://b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4" gracePeriod=120
Aug 04 11:35:50.455388 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:50.455191    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-web" containerID="cri-o://cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf" gracePeriod=120
Aug 04 11:35:51.025332 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025300    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4" exitCode=0
Aug 04 11:35:51.025332 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025324    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c" exitCode=0
Aug 04 11:35:51.025332 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025330    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7" exitCode=0
Aug 04 11:35:51.025332 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025336    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0" exitCode=0
Aug 04 11:35:51.025332 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025341    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059" exitCode=0
Aug 04 11:35:51.025616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025366    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4"}
Aug 04 11:35:51.025616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c"}
Aug 04 11:35:51.025616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025470    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7"}
Aug 04 11:35:51.025616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0"}
Aug 04 11:35:51.025616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.025520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059"}
Aug 04 11:35:51.693012 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.692988    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:51.765079 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.764998    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-cluster-tls-config\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765079 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765071    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765097    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-tls-assets\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765150    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-main-db\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765179    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-volume\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765218    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765278    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-web-config\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765317    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-metrics-client-ca\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-out\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765368    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2j6s\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-kube-api-access-q2j6s\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765428    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-main-tls\") pod \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\" (UID: \"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19\") "
Aug 04 11:35:51.765709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765498    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:51.765709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765654    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-main-db\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.766005 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.765746    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:35:51.766835 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.766804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:35:51.768251 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.768185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.769011 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.768977    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-out" (OuterVolumeSpecName: "config-out") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:51.769113 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.769095    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:35:51.769234 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.768900    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.769295 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.769272    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-volume" (OuterVolumeSpecName: "config-volume") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.770030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.770005    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.770550 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.770531    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-kube-api-access-q2j6s" (OuterVolumeSpecName: "kube-api-access-q2j6s") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "kube-api-access-q2j6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:35:51.770625 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.770566    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.772804 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.772708    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.778350 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.778332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-web-config" (OuterVolumeSpecName: "web-config") pod "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" (UID: "e7f54c84-69fd-43aa-a9d4-bba2d6f43b19"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:51.866975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.866939    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.866975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.866970    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-web-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.866975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.866981    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-metrics-client-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.866975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.866990    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-out\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.866999    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2j6s\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-kube-api-access-q2j6s\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867009    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-main-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867017    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-cluster-tls-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867025    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867034    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-tls-assets\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867043    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867051    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-config-volume\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:51.867276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:51.867059    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:35:52.032767 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.032680    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerID="cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf" exitCode=0
Aug 04 11:35:52.032767 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.032740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf"}
Aug 04 11:35:52.032767 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.032758    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.032973 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.032823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7f54c84-69fd-43aa-a9d4-bba2d6f43b19","Type":"ContainerDied","Data":"66e3aebf563dc012113e7db8a41d251174d39c6b6f539c53488b247d2a7d65e3"}
Aug 04 11:35:52.032973 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.032855    2582 scope.go:117] "RemoveContainer" containerID="b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4"
Aug 04 11:35:52.040844 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.040818    2582 scope.go:117] "RemoveContainer" containerID="412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c"
Aug 04 11:35:52.047741 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.047720    2582 scope.go:117] "RemoveContainer" containerID="e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7"
Aug 04 11:35:52.054276 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.054249    2582 scope.go:117] "RemoveContainer" containerID="cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf"
Aug 04 11:35:52.055548 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.055526    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:35:52.061602 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.061585    2582 scope.go:117] "RemoveContainer" containerID="931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0"
Aug 04 11:35:52.061688 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.061670    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:35:52.070903 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.070888    2582 scope.go:117] "RemoveContainer" containerID="8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059"
Aug 04 11:35:52.077603 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.077586    2582 scope.go:117] "RemoveContainer" containerID="123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb"
Aug 04 11:35:52.084044 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084025    2582 scope.go:117] "RemoveContainer" containerID="b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4"
Aug 04 11:35:52.084309 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.084288    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4\": container with ID starting with b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4 not found: ID does not exist" containerID="b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4"
Aug 04 11:35:52.084380 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084321    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4"} err="failed to get container status \"b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4\": rpc error: code = NotFound desc = could not find container \"b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4\": container with ID starting with b8e22e2792cfcad6ec2668b2fdb49ffa73783a52d66c6c2c117ac896e3ad3ce4 not found: ID does not exist"
Aug 04 11:35:52.084380 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084365    2582 scope.go:117] "RemoveContainer" containerID="412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c"
Aug 04 11:35:52.084627 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.084609    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c\": container with ID starting with 412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c not found: ID does not exist" containerID="412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c"
Aug 04 11:35:52.084670 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084632    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c"} err="failed to get container status \"412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c\": rpc error: code = NotFound desc = could not find container \"412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c\": container with ID starting with 412b0217c2a60c8859f4907642411d54ae59d6de2a248d0a86970839e82a007c not found: ID does not exist"
Aug 04 11:35:52.084670 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084648    2582 scope.go:117] "RemoveContainer" containerID="e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7"
Aug 04 11:35:52.084858 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.084841    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7\": container with ID starting with e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7 not found: ID does not exist" containerID="e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7"
Aug 04 11:35:52.084899 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084863    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7"} err="failed to get container status \"e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7\": rpc error: code = NotFound desc = could not find container \"e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7\": container with ID starting with e7f1353aab1b99b207aa661ec3102cd50c4364b927615ffba3b4e02c8c6b97d7 not found: ID does not exist"
Aug 04 11:35:52.084899 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.084879    2582 scope.go:117] "RemoveContainer" containerID="cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf"
Aug 04 11:35:52.085078 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.085063    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf\": container with ID starting with cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf not found: ID does not exist" containerID="cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf"
Aug 04 11:35:52.085120 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085083    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf"} err="failed to get container status \"cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf\": rpc error: code = NotFound desc = could not find container \"cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf\": container with ID starting with cdddb637ad02d80aca42ab649267132fbb77f6dc4a59a5390141f7762efc52bf not found: ID does not exist"
Aug 04 11:35:52.085120 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085097    2582 scope.go:117] "RemoveContainer" containerID="931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0"
Aug 04 11:35:52.085313 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.085297    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0\": container with ID starting with 931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0 not found: ID does not exist" containerID="931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0"
Aug 04 11:35:52.085355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085317    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0"} err="failed to get container status \"931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0\": rpc error: code = NotFound desc = could not find container \"931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0\": container with ID starting with 931faef71c5b872d46881cb1331c243fbe9c53f77c36bd3b636873e53e9ff1a0 not found: ID does not exist"
Aug 04 11:35:52.085355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085332    2582 scope.go:117] "RemoveContainer" containerID="8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059"
Aug 04 11:35:52.085532 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.085517    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059\": container with ID starting with 8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059 not found: ID does not exist" containerID="8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059"
Aug 04 11:35:52.085577 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085535    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059"} err="failed to get container status \"8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059\": rpc error: code = NotFound desc = could not find container \"8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059\": container with ID starting with 8af079e92d2096e482c71fe8e05db832870ed26db8b57fdda98fe03f01249059 not found: ID does not exist"
Aug 04 11:35:52.085577 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085553    2582 scope.go:117] "RemoveContainer" containerID="123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb"
Aug 04 11:35:52.085793 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:35:52.085776    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb\": container with ID starting with 123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb not found: ID does not exist" containerID="123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb"
Aug 04 11:35:52.085841 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.085796    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb"} err="failed to get container status \"123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb\": rpc error: code = NotFound desc = could not find container \"123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb\": container with ID starting with 123e52f27a8098bd6c4cabf970df90f6dbc50fbd3329428214926851efb81edb not found: ID does not exist"
Aug 04 11:35:52.087770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.087746    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:35:52.088012 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.087996    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088014    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088036    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="alertmanager"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088045    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="alertmanager"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088055    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="config-reloader"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088064    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="config-reloader"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088080    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-web"
Aug 04 11:35:52.088097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088090    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-web"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088103    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="init-config-reloader"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088112    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="init-config-reloader"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088126    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="prom-label-proxy"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088134    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="prom-label-proxy"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088147    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-metric"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088155    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-metric"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088214    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="alertmanager"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088226    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088239    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-web"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088251    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="config-reloader"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088261    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="prom-label-proxy"
Aug 04 11:35:52.088435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.088271    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" containerName="kube-rbac-proxy-metric"
Aug 04 11:35:52.092310 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.092291    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.094229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094196    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 11:35:52.094229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 11:35:52.094229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094225    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 11:35:52.094449 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094225    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 11:35:52.094576 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 11:35:52.094638 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094579    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 11:35:52.094692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094669    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xtr7t\""
Aug 04 11:35:52.094778 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.094763    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 11:35:52.095101 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.095084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 11:35:52.099826 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.099810    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 11:35:52.108878 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.108854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:35:52.169565 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc992e5d-bc18-43c9-8d33-ba5a19104302-config-out\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169565 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169764 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169764 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc992e5d-bc18-43c9-8d33-ba5a19104302-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169764 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169764 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc992e5d-bc18-43c9-8d33-ba5a19104302-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169764 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc992e5d-bc18-43c9-8d33-ba5a19104302-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169764 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169942 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktp4f\" (UniqueName: \"kubernetes.io/projected/cc992e5d-bc18-43c9-8d33-ba5a19104302-kube-api-access-ktp4f\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169942 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169942 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc992e5d-bc18-43c9-8d33-ba5a19104302-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169942 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-web-config\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.169942 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.169888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270203 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270348 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc992e5d-bc18-43c9-8d33-ba5a19104302-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270348 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc992e5d-bc18-43c9-8d33-ba5a19104302-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270511 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270511 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktp4f\" (UniqueName: \"kubernetes.io/projected/cc992e5d-bc18-43c9-8d33-ba5a19104302-kube-api-access-ktp4f\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270511 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270511 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc992e5d-bc18-43c9-8d33-ba5a19104302-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270511 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-web-config\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc992e5d-bc18-43c9-8d33-ba5a19104302-config-out\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.270754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc992e5d-bc18-43c9-8d33-ba5a19104302-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.271008 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.270986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc992e5d-bc18-43c9-8d33-ba5a19104302-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.271171 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.271152    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc992e5d-bc18-43c9-8d33-ba5a19104302-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.271374 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.271352    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc992e5d-bc18-43c9-8d33-ba5a19104302-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.273336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.273308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.273441 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.273394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc992e5d-bc18-43c9-8d33-ba5a19104302-config-out\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.273441 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.273421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.273591 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.273571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.273651 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.273602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc992e5d-bc18-43c9-8d33-ba5a19104302-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.274050 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.274027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-web-config\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.274160 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.274144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.275619 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.275593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.275738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.275723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc992e5d-bc18-43c9-8d33-ba5a19104302-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.278608 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.278590    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktp4f\" (UniqueName: \"kubernetes.io/projected/cc992e5d-bc18-43c9-8d33-ba5a19104302-kube-api-access-ktp4f\") pod \"alertmanager-main-0\" (UID: \"cc992e5d-bc18-43c9-8d33-ba5a19104302\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.348027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.347990    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7f54c84-69fd-43aa-a9d4-bba2d6f43b19" path="/var/lib/kubelet/pods/e7f54c84-69fd-43aa-a9d4-bba2d6f43b19/volumes"
Aug 04 11:35:52.402995 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.402957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 11:35:52.533754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:52.533721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 11:35:52.537257 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:35:52.537233    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc992e5d_bc18_43c9_8d33_ba5a19104302.slice/crio-e886881e14118b0a591b79fa75326e797675b4d331c367cee905bfbf828dca73 WatchSource:0}: Error finding container e886881e14118b0a591b79fa75326e797675b4d331c367cee905bfbf828dca73: Status 404 returned error can't find the container with id e886881e14118b0a591b79fa75326e797675b4d331c367cee905bfbf828dca73
Aug 04 11:35:53.038904 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:53.038818    2582 generic.go:356] "Generic (PLEG): container finished" podID="cc992e5d-bc18-43c9-8d33-ba5a19104302" containerID="5f8f6903b2464f7639eb1313a117e85bf5c7aee8fd7848673904ea62d9df882c" exitCode=0
Aug 04 11:35:53.038904 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:53.038880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerDied","Data":"5f8f6903b2464f7639eb1313a117e85bf5c7aee8fd7848673904ea62d9df882c"}
Aug 04 11:35:53.039273 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:53.038969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"e886881e14118b0a591b79fa75326e797675b4d331c367cee905bfbf828dca73"}
Aug 04 11:35:54.045712 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.045677    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"d52ade934c1146b268e8206ce52034f6cbf04eabf27d52bf69c6d7652cfd7345"}
Aug 04 11:35:54.046094 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.045740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"a8dbbb566760aa36d95abc48630cb7d786881278aba98ff7a6a336d4e44121d9"}
Aug 04 11:35:54.046094 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.045767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"a1010b60104b6a33125c07e37eea2a3205c490e326b0fe5ea2df05ad2e52779e"}
Aug 04 11:35:54.046094 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.045795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"494b746ad2e0c3e174ad3613d369d79aa9ee8f153f59abe5ada3aff0cd1ab153"}
Aug 04 11:35:54.046094 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.045819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"14b6d3c6b3730817e90b936343b23c3072dffad2070b34d8eec64a1bc4e86be0"}
Aug 04 11:35:54.046094 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.045842    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc992e5d-bc18-43c9-8d33-ba5a19104302","Type":"ContainerStarted","Data":"56cb773dacbb24d5c3f9b5f7e0fbcc5f5293527df054c5ec68bfc5cd8c15d8f2"}
Aug 04 11:35:54.071112 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.071070    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.052966532 podStartE2EDuration="2.071053903s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.087371ms" isStatefulPod=false podCreationTimestamp="2026-08-04 11:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:35:54.070042431 +0000 UTC m=+162.244528432" watchObservedRunningTime="2026-08-04 11:35:54.071053903 +0000 UTC m=+162.245539904"
Aug 04 11:35:54.480748 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.480711    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"]
Aug 04 11:35:54.483636 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.483604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.486532 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.486036    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 11:35:54.486532 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.486311    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 11:35:54.486532 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.486317    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 11:35:54.486532 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.486333    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 11:35:54.487282 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.487260    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 11:35:54.487453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.487315    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rwkbl\""
Aug 04 11:35:54.492115 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.492094    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 11:35:54.501599 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.501580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"]
Aug 04 11:35:54.588911 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.588881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-metrics-client-ca\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589065 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.588941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-federate-client-tls\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589065 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.589012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-serving-certs-ca-bundle\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589065 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.589053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rffdt\" (UniqueName: \"kubernetes.io/projected/a09a0f3a-e004-49f8-8a52-5ceee43f6944-kube-api-access-rffdt\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589177 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.589074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589177 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.589153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-telemeter-client-tls\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589243 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.589178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-secret-telemeter-client\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.589243 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.589202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690306 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-federate-client-tls\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690306 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-serving-certs-ca-bundle\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffdt\" (UniqueName: \"kubernetes.io/projected/a09a0f3a-e004-49f8-8a52-5ceee43f6944-kube-api-access-rffdt\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-telemeter-client-tls\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-secret-telemeter-client\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690582 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.690822 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.690609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-metrics-client-ca\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.691227 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.691198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-serving-certs-ca-bundle\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.691374 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.691352    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-metrics-client-ca\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.691607 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.691586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a09a0f3a-e004-49f8-8a52-5ceee43f6944-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.692988 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.692959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-federate-client-tls\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.693071 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.692998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-secret-telemeter-client\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.693177 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.693161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.693298 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.693276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a09a0f3a-e004-49f8-8a52-5ceee43f6944-telemeter-client-tls\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.697687 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.697665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rffdt\" (UniqueName: \"kubernetes.io/projected/a09a0f3a-e004-49f8-8a52-5ceee43f6944-kube-api-access-rffdt\") pod \"telemeter-client-58ffffcfbb-n56sw\" (UID: \"a09a0f3a-e004-49f8-8a52-5ceee43f6944\") " pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.795731 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.795655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"
Aug 04 11:35:54.924519 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:54.924489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58ffffcfbb-n56sw"]
Aug 04 11:35:54.927804 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:35:54.927777    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09a0f3a_e004_49f8_8a52_5ceee43f6944.slice/crio-4e707b9ae2b88066cc20cc483b31c7a1a3c1f006abf98316baeb6a97ed5dbe19 WatchSource:0}: Error finding container 4e707b9ae2b88066cc20cc483b31c7a1a3c1f006abf98316baeb6a97ed5dbe19: Status 404 returned error can't find the container with id 4e707b9ae2b88066cc20cc483b31c7a1a3c1f006abf98316baeb6a97ed5dbe19
Aug 04 11:35:55.050817 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:55.050726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw" event={"ID":"a09a0f3a-e004-49f8-8a52-5ceee43f6944","Type":"ContainerStarted","Data":"4e707b9ae2b88066cc20cc483b31c7a1a3c1f006abf98316baeb6a97ed5dbe19"}
Aug 04 11:35:58.064027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:58.063994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw" event={"ID":"a09a0f3a-e004-49f8-8a52-5ceee43f6944","Type":"ContainerStarted","Data":"eb56945346d62310bbd17f60d44bc512c4addbff3daa40bc90165c0df1c6f871"}
Aug 04 11:35:58.064434 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:58.064052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw" event={"ID":"a09a0f3a-e004-49f8-8a52-5ceee43f6944","Type":"ContainerStarted","Data":"306b4f2ea78902f69c53f61611b335f0dabc68369bf226f8149724846e5ec20e"}
Aug 04 11:35:58.064434 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:58.064076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw" event={"ID":"a09a0f3a-e004-49f8-8a52-5ceee43f6944","Type":"ContainerStarted","Data":"7b7697c53806481018ba04deff812dbf47016aec64040b3c7b4b6620413d2d2a"}
Aug 04 11:35:58.084435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:35:58.084364    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-58ffffcfbb-n56sw" podStartSLOduration=1.8211881810000001 podStartE2EDuration="4.084347533s" totalImagesPullingTime="2.263159352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:35:58.082477328 +0000 UTC m=+166.256963329" watchObservedRunningTime="2026-08-04 11:35:58.084347533 +0000 UTC m=+166.258833535"
Aug 04 11:36:08.934879 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:08.934807    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d45585f8-dtltr"]
Aug 04 11:36:33.956836 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:33.956781    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d45585f8-dtltr" podUID="f00f0d99-0ba8-4563-b678-eeb0d8e44340" containerName="console" containerID="cri-o://8c88057cffd6b521a7608acb525c540e5c0047fa28e4aaca0eef380e8646820e" gracePeriod=15
Aug 04 11:36:34.186319 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.186288    2582 generic.go:356] "Generic (PLEG): container finished" podID="f00f0d99-0ba8-4563-b678-eeb0d8e44340" containerID="8c88057cffd6b521a7608acb525c540e5c0047fa28e4aaca0eef380e8646820e" exitCode=0
Aug 04 11:36:34.186468 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.186329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45585f8-dtltr" event={"ID":"f00f0d99-0ba8-4563-b678-eeb0d8e44340","Type":"ContainerDied","Data":"8c88057cffd6b521a7608acb525c540e5c0047fa28e4aaca0eef380e8646820e"}
Aug 04 11:36:34.186468 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.186368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d45585f8-dtltr" event={"ID":"f00f0d99-0ba8-4563-b678-eeb0d8e44340","Type":"ContainerDied","Data":"7d3a27f2c60a24de263641278cdbe3292bb943b56ad15f7df9478a8e4b014516"}
Aug 04 11:36:34.186468 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.186384    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d3a27f2c60a24de263641278cdbe3292bb943b56ad15f7df9478a8e4b014516"
Aug 04 11:36:34.188512 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.188495    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:36:34.201936 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.201917    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-oauth-config\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.201944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-trusted-ca-bundle\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.201984    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rttfg\" (UniqueName: \"kubernetes.io/projected/f00f0d99-0ba8-4563-b678-eeb0d8e44340-kube-api-access-rttfg\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-oauth-serving-cert\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202157 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-serving-cert\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202157 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202058    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-config\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202157 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202082    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-service-ca\") pod \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\" (UID: \"f00f0d99-0ba8-4563-b678-eeb0d8e44340\") "
Aug 04 11:36:34.202480 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:36:34.202480 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202462    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:36:34.202628 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202495    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-config" (OuterVolumeSpecName: "console-config") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:36:34.202628 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.202567    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-service-ca" (OuterVolumeSpecName: "service-ca") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:36:34.204080 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.204066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:36:34.204513 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.204486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00f0d99-0ba8-4563-b678-eeb0d8e44340-kube-api-access-rttfg" (OuterVolumeSpecName: "kube-api-access-rttfg") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "kube-api-access-rttfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:36:34.204513 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.204491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f00f0d99-0ba8-4563-b678-eeb0d8e44340" (UID: "f00f0d99-0ba8-4563-b678-eeb0d8e44340"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:36:34.302531 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302496    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:34.302531 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302524    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:34.302531 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302532    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-oauth-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:34.302738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302542    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-trusted-ca-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:34.302738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302552    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rttfg\" (UniqueName: \"kubernetes.io/projected/f00f0d99-0ba8-4563-b678-eeb0d8e44340-kube-api-access-rttfg\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:34.302738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302560    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f00f0d99-0ba8-4563-b678-eeb0d8e44340-oauth-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:34.302738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:34.302570    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f00f0d99-0ba8-4563-b678-eeb0d8e44340-console-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:36:35.189962 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:35.189933    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d45585f8-dtltr"
Aug 04 11:36:35.206097 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:35.206070    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d45585f8-dtltr"]
Aug 04 11:36:35.210486 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:35.210464    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d45585f8-dtltr"]
Aug 04 11:36:36.347776 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:36:36.347741    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f00f0d99-0ba8-4563-b678-eeb0d8e44340" path="/var/lib/kubelet/pods/f00f0d99-0ba8-4563-b678-eeb0d8e44340/volumes"
Aug 04 11:37:48.008119 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.008035    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"]
Aug 04 11:37:48.008691 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.008471    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00f0d99-0ba8-4563-b678-eeb0d8e44340" containerName="console"
Aug 04 11:37:48.008691 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.008488    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00f0d99-0ba8-4563-b678-eeb0d8e44340" containerName="console"
Aug 04 11:37:48.008691 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.008550    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00f0d99-0ba8-4563-b678-eeb0d8e44340" containerName="console"
Aug 04 11:37:48.011417 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.011382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.013743 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.013722    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 11:37:48.014293 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.014275    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 11:37:48.014356 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.014294    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vxtl\""
Aug 04 11:37:48.019892 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.019870    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"]
Aug 04 11:37:48.046189 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.046158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.046310 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.046206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.046310 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.046268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvf9v\" (UniqueName: \"kubernetes.io/projected/77c4562a-d779-4185-b607-e95e74f0305a-kube-api-access-zvf9v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.147393 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.147362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvf9v\" (UniqueName: \"kubernetes.io/projected/77c4562a-d779-4185-b607-e95e74f0305a-kube-api-access-zvf9v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.147532 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.147517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.147590 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.147549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.147911 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.147894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.147964 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.147924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.156305 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.156280    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvf9v\" (UniqueName: \"kubernetes.io/projected/77c4562a-d779-4185-b607-e95e74f0305a-kube-api-access-zvf9v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.320267 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.320177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:37:48.456206 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:48.456163    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"]
Aug 04 11:37:48.458823 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:37:48.458801    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c4562a_d779_4185_b607_e95e74f0305a.slice/crio-7403012b3b0bd48af652c78fc66a2fce25f25fa10401c1b0e720868f766a5101 WatchSource:0}: Error finding container 7403012b3b0bd48af652c78fc66a2fce25f25fa10401c1b0e720868f766a5101: Status 404 returned error can't find the container with id 7403012b3b0bd48af652c78fc66a2fce25f25fa10401c1b0e720868f766a5101
Aug 04 11:37:49.443653 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:49.443615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq" event={"ID":"77c4562a-d779-4185-b607-e95e74f0305a","Type":"ContainerStarted","Data":"7403012b3b0bd48af652c78fc66a2fce25f25fa10401c1b0e720868f766a5101"}
Aug 04 11:37:54.463536 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:54.463509    2582 generic.go:356] "Generic (PLEG): container finished" podID="77c4562a-d779-4185-b607-e95e74f0305a" containerID="d2ec56a9c921f214a1bd5d9b8c3f929f946dae4bb28d27e79adc8a8a62d76bf3" exitCode=0
Aug 04 11:37:54.463874 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:54.463591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq" event={"ID":"77c4562a-d779-4185-b607-e95e74f0305a","Type":"ContainerDied","Data":"d2ec56a9c921f214a1bd5d9b8c3f929f946dae4bb28d27e79adc8a8a62d76bf3"}
Aug 04 11:37:57.477743 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:57.477706    2582 generic.go:356] "Generic (PLEG): container finished" podID="77c4562a-d779-4185-b607-e95e74f0305a" containerID="8d09b39ab16f28968369123b9e01af5b8a108bbc9869105131c7065bc3295f9c" exitCode=0
Aug 04 11:37:57.478128 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:37:57.477767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq" event={"ID":"77c4562a-d779-4185-b607-e95e74f0305a","Type":"ContainerDied","Data":"8d09b39ab16f28968369123b9e01af5b8a108bbc9869105131c7065bc3295f9c"}
Aug 04 11:38:04.507883 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:04.507847    2582 generic.go:356] "Generic (PLEG): container finished" podID="77c4562a-d779-4185-b607-e95e74f0305a" containerID="65f4cd656368ed1de052a543e930637b7c1e32507257692a5b56bd355d9a6279" exitCode=0
Aug 04 11:38:04.508244 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:04.507917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq" event={"ID":"77c4562a-d779-4185-b607-e95e74f0305a","Type":"ContainerDied","Data":"65f4cd656368ed1de052a543e930637b7c1e32507257692a5b56bd355d9a6279"}
Aug 04 11:38:05.632327 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.632302    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:38:05.690019 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.689992    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvf9v\" (UniqueName: \"kubernetes.io/projected/77c4562a-d779-4185-b607-e95e74f0305a-kube-api-access-zvf9v\") pod \"77c4562a-d779-4185-b607-e95e74f0305a\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") "
Aug 04 11:38:05.690174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.690043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-bundle\") pod \"77c4562a-d779-4185-b607-e95e74f0305a\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") "
Aug 04 11:38:05.690174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.690080    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-util\") pod \"77c4562a-d779-4185-b607-e95e74f0305a\" (UID: \"77c4562a-d779-4185-b607-e95e74f0305a\") "
Aug 04 11:38:05.690910 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.690873    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-bundle" (OuterVolumeSpecName: "bundle") pod "77c4562a-d779-4185-b607-e95e74f0305a" (UID: "77c4562a-d779-4185-b607-e95e74f0305a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:05.692259 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.692234    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c4562a-d779-4185-b607-e95e74f0305a-kube-api-access-zvf9v" (OuterVolumeSpecName: "kube-api-access-zvf9v") pod "77c4562a-d779-4185-b607-e95e74f0305a" (UID: "77c4562a-d779-4185-b607-e95e74f0305a"). InnerVolumeSpecName "kube-api-access-zvf9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:38:05.694559 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.694532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-util" (OuterVolumeSpecName: "util") pod "77c4562a-d779-4185-b607-e95e74f0305a" (UID: "77c4562a-d779-4185-b607-e95e74f0305a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:05.791308 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.791232    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvf9v\" (UniqueName: \"kubernetes.io/projected/77c4562a-d779-4185-b607-e95e74f0305a-kube-api-access-zvf9v\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:38:05.791308 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.791258    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:38:05.791308 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:05.791267    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77c4562a-d779-4185-b607-e95e74f0305a-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:38:06.517028 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:06.517001    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq"
Aug 04 11:38:06.517028 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:06.517009    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dchbq" event={"ID":"77c4562a-d779-4185-b607-e95e74f0305a","Type":"ContainerDied","Data":"7403012b3b0bd48af652c78fc66a2fce25f25fa10401c1b0e720868f766a5101"}
Aug 04 11:38:06.517208 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:06.517052    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7403012b3b0bd48af652c78fc66a2fce25f25fa10401c1b0e720868f766a5101"
Aug 04 11:38:12.203455 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:12.203416    2582 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 11:38:25.804453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804423    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-89l7b"]
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804670    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="util"
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804680    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="util"
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804693    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="extract"
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804698    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="extract"
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804707    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="pull"
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804712    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="pull"
Aug 04 11:38:25.805869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.804762    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c4562a-d779-4185-b607-e95e74f0305a" containerName="extract"
Aug 04 11:38:25.806568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.806552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:25.809215 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.809197    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 11:38:25.809839 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.809821    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 11:38:25.809924 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.809822    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nccdp\""
Aug 04 11:38:25.816627 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.816609    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-89l7b"]
Aug 04 11:38:25.941445 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.941391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b6daab-c2d3-4241-a9b1-1c3e9515103e-bound-sa-token\") pod \"cert-manager-55b4d954d5-89l7b\" (UID: \"49b6daab-c2d3-4241-a9b1-1c3e9515103e\") " pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:25.941620 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:25.941480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plfkk\" (UniqueName: \"kubernetes.io/projected/49b6daab-c2d3-4241-a9b1-1c3e9515103e-kube-api-access-plfkk\") pod \"cert-manager-55b4d954d5-89l7b\" (UID: \"49b6daab-c2d3-4241-a9b1-1c3e9515103e\") " pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:26.042179 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.042146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plfkk\" (UniqueName: \"kubernetes.io/projected/49b6daab-c2d3-4241-a9b1-1c3e9515103e-kube-api-access-plfkk\") pod \"cert-manager-55b4d954d5-89l7b\" (UID: \"49b6daab-c2d3-4241-a9b1-1c3e9515103e\") " pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:26.042311 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.042198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b6daab-c2d3-4241-a9b1-1c3e9515103e-bound-sa-token\") pod \"cert-manager-55b4d954d5-89l7b\" (UID: \"49b6daab-c2d3-4241-a9b1-1c3e9515103e\") " pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:26.056343 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.056282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b6daab-c2d3-4241-a9b1-1c3e9515103e-bound-sa-token\") pod \"cert-manager-55b4d954d5-89l7b\" (UID: \"49b6daab-c2d3-4241-a9b1-1c3e9515103e\") " pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:26.056461 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.056362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plfkk\" (UniqueName: \"kubernetes.io/projected/49b6daab-c2d3-4241-a9b1-1c3e9515103e-kube-api-access-plfkk\") pod \"cert-manager-55b4d954d5-89l7b\" (UID: \"49b6daab-c2d3-4241-a9b1-1c3e9515103e\") " pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:26.114853 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.114824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-89l7b"
Aug 04 11:38:26.231178 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.231141    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-89l7b"]
Aug 04 11:38:26.233971 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:38:26.233945    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49b6daab_c2d3_4241_a9b1_1c3e9515103e.slice/crio-c532a18f701e342db9d096b18e6857ae3cd373c283c434e2fe800641f60722ad WatchSource:0}: Error finding container c532a18f701e342db9d096b18e6857ae3cd373c283c434e2fe800641f60722ad: Status 404 returned error can't find the container with id c532a18f701e342db9d096b18e6857ae3cd373c283c434e2fe800641f60722ad
Aug 04 11:38:26.235935 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.235920    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 11:38:26.588173 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:26.588140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-89l7b" event={"ID":"49b6daab-c2d3-4241-a9b1-1c3e9515103e","Type":"ContainerStarted","Data":"c532a18f701e342db9d096b18e6857ae3cd373c283c434e2fe800641f60722ad"}
Aug 04 11:38:29.600722 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:29.600688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-89l7b" event={"ID":"49b6daab-c2d3-4241-a9b1-1c3e9515103e","Type":"ContainerStarted","Data":"91b4c3942007854730e0fac6aa2e684e3a7d00e3ab788ad62dffe1ea0d32ab8a"}
Aug 04 11:38:29.618840 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:29.618796    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-89l7b" podStartSLOduration=1.467370573 podStartE2EDuration="4.618780734s" totalImagesPullingTime="3.151410161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:38:29.617917004 +0000 UTC m=+317.792403006" watchObservedRunningTime="2026-08-04 11:38:29.618780734 +0000 UTC m=+317.793266735"
Aug 04 11:38:43.223058 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.223011    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"]
Aug 04 11:38:43.224974 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.224957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.227024 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.227005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wvdvq\""
Aug 04 11:38:43.227024 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.227012    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 11:38:43.227511 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.227440    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 11:38:43.236783 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.236764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"]
Aug 04 11:38:43.274490 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.274462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qg5\" (UniqueName: \"kubernetes.io/projected/8c44a5ca-7312-400b-b749-cea3e0e85f94-kube-api-access-c8qg5\") pod \"openshift-lws-operator-fd8ccff4c-vl6f7\" (UID: \"8c44a5ca-7312-400b-b749-cea3e0e85f94\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.274602 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.274507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c44a5ca-7312-400b-b749-cea3e0e85f94-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vl6f7\" (UID: \"8c44a5ca-7312-400b-b749-cea3e0e85f94\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.375401 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.375369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c44a5ca-7312-400b-b749-cea3e0e85f94-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vl6f7\" (UID: \"8c44a5ca-7312-400b-b749-cea3e0e85f94\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.375555 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.375471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qg5\" (UniqueName: \"kubernetes.io/projected/8c44a5ca-7312-400b-b749-cea3e0e85f94-kube-api-access-c8qg5\") pod \"openshift-lws-operator-fd8ccff4c-vl6f7\" (UID: \"8c44a5ca-7312-400b-b749-cea3e0e85f94\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.375710 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.375687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c44a5ca-7312-400b-b749-cea3e0e85f94-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vl6f7\" (UID: \"8c44a5ca-7312-400b-b749-cea3e0e85f94\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.383514 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.383496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qg5\" (UniqueName: \"kubernetes.io/projected/8c44a5ca-7312-400b-b749-cea3e0e85f94-kube-api-access-c8qg5\") pod \"openshift-lws-operator-fd8ccff4c-vl6f7\" (UID: \"8c44a5ca-7312-400b-b749-cea3e0e85f94\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.533855 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.533774    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"
Aug 04 11:38:43.651138 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:43.651104    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7"]
Aug 04 11:38:43.653759 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:38:43.653733    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c44a5ca_7312_400b_b749_cea3e0e85f94.slice/crio-0307da1f44f078710be4eb236350d69fd7c3e31236d8a7f9442989d2ee853b6a WatchSource:0}: Error finding container 0307da1f44f078710be4eb236350d69fd7c3e31236d8a7f9442989d2ee853b6a: Status 404 returned error can't find the container with id 0307da1f44f078710be4eb236350d69fd7c3e31236d8a7f9442989d2ee853b6a
Aug 04 11:38:44.654009 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:44.653968    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7" event={"ID":"8c44a5ca-7312-400b-b749-cea3e0e85f94","Type":"ContainerStarted","Data":"0307da1f44f078710be4eb236350d69fd7c3e31236d8a7f9442989d2ee853b6a"}
Aug 04 11:38:46.665227 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:46.665127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7" event={"ID":"8c44a5ca-7312-400b-b749-cea3e0e85f94","Type":"ContainerStarted","Data":"d741c303ea59c518f3e17a7d14c0a3e79ec5d41fa0faee12b5cbe13fca9a74f2"}
Aug 04 11:38:46.683075 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:38:46.683028    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vl6f7" podStartSLOduration=0.95487934 podStartE2EDuration="3.683012822s" totalImagesPullingTime="2.728133482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:38:46.681364152 +0000 UTC m=+334.855850154" watchObservedRunningTime="2026-08-04 11:38:46.683012822 +0000 UTC m=+334.857498822"
Aug 04 11:39:06.206614 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.206536    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"]
Aug 04 11:39:06.209675 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.209657    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.212039 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.212016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 11:39:06.212829 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.212781    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zv97q\""
Aug 04 11:39:06.212829 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.212802    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 11:39:06.212829 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.212818    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 11:39:06.213026 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.212877    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 11:39:06.224353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.224333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea33c76e-cd9f-4942-8537-4bafd6417fe1-tmp\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.224465 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.224361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea33c76e-cd9f-4942-8537-4bafd6417fe1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.224465 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.224384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea33c76e-cd9f-4942-8537-4bafd6417fe1-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.224543 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.224471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd5dt\" (UniqueName: \"kubernetes.io/projected/ea33c76e-cd9f-4942-8537-4bafd6417fe1-kube-api-access-zd5dt\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.224543 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.224523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea33c76e-cd9f-4942-8537-4bafd6417fe1-manifests\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.228349 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.228327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"]
Aug 04 11:39:06.325079 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.325050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea33c76e-cd9f-4942-8537-4bafd6417fe1-manifests\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.325253 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.325088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea33c76e-cd9f-4942-8537-4bafd6417fe1-tmp\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.325253 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.325116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea33c76e-cd9f-4942-8537-4bafd6417fe1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.325253 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.325149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea33c76e-cd9f-4942-8537-4bafd6417fe1-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.325253 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.325205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd5dt\" (UniqueName: \"kubernetes.io/projected/ea33c76e-cd9f-4942-8537-4bafd6417fe1-kube-api-access-zd5dt\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.325498 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.325425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea33c76e-cd9f-4942-8537-4bafd6417fe1-manifests\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.327510 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.327472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea33c76e-cd9f-4942-8537-4bafd6417fe1-tmp\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.327644 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.327529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea33c76e-cd9f-4942-8537-4bafd6417fe1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.327704 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.327662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea33c76e-cd9f-4942-8537-4bafd6417fe1-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.341434 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.341398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd5dt\" (UniqueName: \"kubernetes.io/projected/ea33c76e-cd9f-4942-8537-4bafd6417fe1-kube-api-access-zd5dt\") pod \"opendatahub-operator-controller-manager-59f8dd78b9-sf6wq\" (UID: \"ea33c76e-cd9f-4942-8537-4bafd6417fe1\") " pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.519619 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.519538    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:06.653841 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.653812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"]
Aug 04 11:39:06.656071 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:06.656045    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea33c76e_cd9f_4942_8537_4bafd6417fe1.slice/crio-0b518f094393f39696a4ec9a788eac819ed56ff43dc6f10608256948c58d6f09 WatchSource:0}: Error finding container 0b518f094393f39696a4ec9a788eac819ed56ff43dc6f10608256948c58d6f09: Status 404 returned error can't find the container with id 0b518f094393f39696a4ec9a788eac819ed56ff43dc6f10608256948c58d6f09
Aug 04 11:39:06.743021 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:06.742993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq" event={"ID":"ea33c76e-cd9f-4942-8537-4bafd6417fe1","Type":"ContainerStarted","Data":"0b518f094393f39696a4ec9a788eac819ed56ff43dc6f10608256948c58d6f09"}
Aug 04 11:39:09.759067 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:09.759021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq" event={"ID":"ea33c76e-cd9f-4942-8537-4bafd6417fe1","Type":"ContainerStarted","Data":"40410cb5615811762bf2ff8c0e791f88719f0d415ebcdd08fa3d843dc724e689"}
Aug 04 11:39:10.764418 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:10.764377    2582 generic.go:356] "Generic (PLEG): container finished" podID="ea33c76e-cd9f-4942-8537-4bafd6417fe1" containerID="40410cb5615811762bf2ff8c0e791f88719f0d415ebcdd08fa3d843dc724e689" exitCode=0
Aug 04 11:39:10.764814 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:10.764464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq" event={"ID":"ea33c76e-cd9f-4942-8537-4bafd6417fe1","Type":"ContainerDied","Data":"40410cb5615811762bf2ff8c0e791f88719f0d415ebcdd08fa3d843dc724e689"}
Aug 04 11:39:11.770491 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:11.770454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq" event={"ID":"ea33c76e-cd9f-4942-8537-4bafd6417fe1","Type":"ContainerStarted","Data":"1cdace0e172f20fb949a5ddf89b2b2021a616fdb2d2fa7b863f345c5e94e1d3e"}
Aug 04 11:39:11.770875 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:11.770609    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:11.820758 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:11.820705    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq" podStartSLOduration=1.3761923249999999 podStartE2EDuration="5.82068792s" totalImagesPullingTime="3.353245776s" totalInitContainerRuntime="1.091249819s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:11.819509745 +0000 UTC m=+359.993995875" watchObservedRunningTime="2026-08-04 11:39:11.82068792 +0000 UTC m=+359.995173922"
Aug 04 11:39:22.777236 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:22.777208    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59f8dd78b9-sf6wq"
Aug 04 11:39:36.406636 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.406602    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"]
Aug 04 11:39:36.409655 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.409636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.411590 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.411560    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 11:39:36.411590 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.411588    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 11:39:36.411775 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.411562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 11:39:36.411853 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.411833    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 11:39:36.412122 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.412108    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t8btz\""
Aug 04 11:39:36.421928 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.421905    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"]
Aug 04 11:39:36.462743 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.462717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89a28ef5-88cb-423e-8aa2-c4e03b648122-tls-certs\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.462871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.462774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89a28ef5-88cb-423e-8aa2-c4e03b648122-tmp\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.462871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.462803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zb2f\" (UniqueName: \"kubernetes.io/projected/89a28ef5-88cb-423e-8aa2-c4e03b648122-kube-api-access-4zb2f\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.560012 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.559980    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fdcnd"]
Aug 04 11:39:36.563127 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.563112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:36.563341 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.563311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89a28ef5-88cb-423e-8aa2-c4e03b648122-tls-certs\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.563495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.563434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89a28ef5-88cb-423e-8aa2-c4e03b648122-tmp\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.563495 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.563472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zb2f\" (UniqueName: \"kubernetes.io/projected/89a28ef5-88cb-423e-8aa2-c4e03b648122-kube-api-access-4zb2f\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.563602 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:39:36.563498    2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 04 11:39:36.563602 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:39:36.563562    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89a28ef5-88cb-423e-8aa2-c4e03b648122-tls-certs podName:89a28ef5-88cb-423e-8aa2-c4e03b648122 nodeName:}" failed. No retries permitted until 2026-08-04 11:39:37.063542422 +0000 UTC m=+385.238028401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/89a28ef5-88cb-423e-8aa2-c4e03b648122-tls-certs") pod "kube-auth-proxy-96bfd8458-fkkfp" (UID: "89a28ef5-88cb-423e-8aa2-c4e03b648122") : secret "kube-auth-proxy-tls" not found
Aug 04 11:39:36.565574 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.565559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89a28ef5-88cb-423e-8aa2-c4e03b648122-tmp\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.569359 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.569183    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 04 11:39:36.569359 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.569189    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sfvhj\""
Aug 04 11:39:36.582211 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.582187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fdcnd"]
Aug 04 11:39:36.585981 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.585951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zb2f\" (UniqueName: \"kubernetes.io/projected/89a28ef5-88cb-423e-8aa2-c4e03b648122-kube-api-access-4zb2f\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:36.664625 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.664553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2qzk\" (UniqueName: \"kubernetes.io/projected/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-kube-api-access-z2qzk\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:36.664753 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.664645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-cert\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:36.765692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.765658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2qzk\" (UniqueName: \"kubernetes.io/projected/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-kube-api-access-z2qzk\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:36.765843 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.765719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-cert\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:36.765843 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:39:36.765800    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 04 11:39:36.765970 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:39:36.765888    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-cert podName:3c1a7416-6d8e-4461-aca1-25cb07f7ab0f nodeName:}" failed. No retries permitted until 2026-08-04 11:39:37.265862277 +0000 UTC m=+385.440348268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-cert") pod "odh-model-controller-7998c67dc4-fdcnd" (UID: "3c1a7416-6d8e-4461-aca1-25cb07f7ab0f") : secret "odh-model-controller-webhook-cert" not found
Aug 04 11:39:36.775509 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:36.775485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2qzk\" (UniqueName: \"kubernetes.io/projected/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-kube-api-access-z2qzk\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:37.067656 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.067573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89a28ef5-88cb-423e-8aa2-c4e03b648122-tls-certs\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:37.070038 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.070018    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89a28ef5-88cb-423e-8aa2-c4e03b648122-tls-certs\") pod \"kube-auth-proxy-96bfd8458-fkkfp\" (UID: \"89a28ef5-88cb-423e-8aa2-c4e03b648122\") " pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:37.269750 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.269714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-cert\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:37.272104 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.272074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1a7416-6d8e-4461-aca1-25cb07f7ab0f-cert\") pod \"odh-model-controller-7998c67dc4-fdcnd\" (UID: \"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f\") " pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:37.296057 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.296032    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ck56r"]
Aug 04 11:39:37.299251 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.299236    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.308952 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.308935    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 04 11:39:37.318985 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.318929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"
Aug 04 11:39:37.319605 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.319580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ck56r"]
Aug 04 11:39:37.370476 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.370436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e96719-9d73-4341-a087-416ee32b90b1-tls-certs\") pod \"model-serving-api-54d89bd5fc-ck56r\" (UID: \"21e96719-9d73-4341-a087-416ee32b90b1\") " pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.370618 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.370525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7j2\" (UniqueName: \"kubernetes.io/projected/21e96719-9d73-4341-a087-416ee32b90b1-kube-api-access-fq7j2\") pod \"model-serving-api-54d89bd5fc-ck56r\" (UID: \"21e96719-9d73-4341-a087-416ee32b90b1\") " pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.451622 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.451564    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp"]
Aug 04 11:39:37.454173 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:37.454147    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a28ef5_88cb_423e_8aa2_c4e03b648122.slice/crio-b6667062b40d07f703677b001bf3d828dea322c48b19b0ec03996a678f7d20e9 WatchSource:0}: Error finding container b6667062b40d07f703677b001bf3d828dea322c48b19b0ec03996a678f7d20e9: Status 404 returned error can't find the container with id b6667062b40d07f703677b001bf3d828dea322c48b19b0ec03996a678f7d20e9
Aug 04 11:39:37.471176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.471152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e96719-9d73-4341-a087-416ee32b90b1-tls-certs\") pod \"model-serving-api-54d89bd5fc-ck56r\" (UID: \"21e96719-9d73-4341-a087-416ee32b90b1\") " pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.471268 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.471206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7j2\" (UniqueName: \"kubernetes.io/projected/21e96719-9d73-4341-a087-416ee32b90b1-kube-api-access-fq7j2\") pod \"model-serving-api-54d89bd5fc-ck56r\" (UID: \"21e96719-9d73-4341-a087-416ee32b90b1\") " pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.473417 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.473383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e96719-9d73-4341-a087-416ee32b90b1-tls-certs\") pod \"model-serving-api-54d89bd5fc-ck56r\" (UID: \"21e96719-9d73-4341-a087-416ee32b90b1\") " pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.482288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.482272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:37.493861 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.493839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7j2\" (UniqueName: \"kubernetes.io/projected/21e96719-9d73-4341-a087-416ee32b90b1-kube-api-access-fq7j2\") pod \"model-serving-api-54d89bd5fc-ck56r\" (UID: \"21e96719-9d73-4341-a087-416ee32b90b1\") " pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.606368 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.606347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fdcnd"]
Aug 04 11:39:37.608195 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:37.608165    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1a7416_6d8e_4461_aca1_25cb07f7ab0f.slice/crio-0b0195a93ff3985cc3c2f42f5db2884c433ad565ad137dd78515f90a6a93b612 WatchSource:0}: Error finding container 0b0195a93ff3985cc3c2f42f5db2884c433ad565ad137dd78515f90a6a93b612: Status 404 returned error can't find the container with id 0b0195a93ff3985cc3c2f42f5db2884c433ad565ad137dd78515f90a6a93b612
Aug 04 11:39:37.612754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.612734    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:37.741229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.741207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ck56r"]
Aug 04 11:39:37.743218 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:37.743192    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e96719_9d73_4341_a087_416ee32b90b1.slice/crio-643512b4e89fc6cb33620670422cfd2065f8bbfd33f51a34439505ea23a6e836 WatchSource:0}: Error finding container 643512b4e89fc6cb33620670422cfd2065f8bbfd33f51a34439505ea23a6e836: Status 404 returned error can't find the container with id 643512b4e89fc6cb33620670422cfd2065f8bbfd33f51a34439505ea23a6e836
Aug 04 11:39:37.883183 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.883101    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"]
Aug 04 11:39:37.887566 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.887543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r" event={"ID":"21e96719-9d73-4341-a087-416ee32b90b1","Type":"ContainerStarted","Data":"643512b4e89fc6cb33620670422cfd2065f8bbfd33f51a34439505ea23a6e836"}
Aug 04 11:39:37.887670 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.887573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd" event={"ID":"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f","Type":"ContainerStarted","Data":"0b0195a93ff3985cc3c2f42f5db2884c433ad565ad137dd78515f90a6a93b612"}
Aug 04 11:39:37.887670 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.887591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp" event={"ID":"89a28ef5-88cb-423e-8aa2-c4e03b648122","Type":"ContainerStarted","Data":"b6667062b40d07f703677b001bf3d828dea322c48b19b0ec03996a678f7d20e9"}
Aug 04 11:39:37.887670 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.887662    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.891398 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.891375    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 11:39:37.891528 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.891394    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 11:39:37.891528 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.891418    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 11:39:37.891528 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.891448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 11:39:37.892032 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.892018    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vjj78\""
Aug 04 11:39:37.906051 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.906032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"]
Aug 04 11:39:37.974846 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.974811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.974846 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.974847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.975072 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.974894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.975072 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.974945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm87n\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-kube-api-access-hm87n\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.975072 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.975003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec851247-fabf-4167-b5a6-3475b09575bd-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.975072 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.975055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:37.975228 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:37.975076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.075922 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.075881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec851247-fabf-4167-b5a6-3475b09575bd-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.075922 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.075924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.076123 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.075943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.076159 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.076133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.076193 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.076178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.076254 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.076237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.076304 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.076275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm87n\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-kube-api-access-hm87n\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.076903 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.076872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.078428 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.078388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec851247-fabf-4167-b5a6-3475b09575bd-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.078428 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.078398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.078611 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.078459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.078611 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.078571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.084172 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.084148    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm87n\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-kube-api-access-hm87n\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.084363 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.084345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-npxlj\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.197530 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.197443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:38.363428 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.363386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"]
Aug 04 11:39:38.365649 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:38.365619    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec851247_fabf_4167_b5a6_3475b09575bd.slice/crio-50e0498b79d1c608e60af7013306dee9cebbcca4a4589ecb291ecfd412e92e02 WatchSource:0}: Error finding container 50e0498b79d1c608e60af7013306dee9cebbcca4a4589ecb291ecfd412e92e02: Status 404 returned error can't find the container with id 50e0498b79d1c608e60af7013306dee9cebbcca4a4589ecb291ecfd412e92e02
Aug 04 11:39:38.895825 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:38.895731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" event={"ID":"ec851247-fabf-4167-b5a6-3475b09575bd","Type":"ContainerStarted","Data":"50e0498b79d1c608e60af7013306dee9cebbcca4a4589ecb291ecfd412e92e02"}
Aug 04 11:39:39.864761 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.863231    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-df5f5fb7c-5hb4n"]
Aug 04 11:39:39.869129 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.868399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.871429 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.870930    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 11:39:39.871429 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.871248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 11:39:39.871591 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.871504    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 11:39:39.871759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.871735    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 11:39:39.871838 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.871794    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cj6dc\""
Aug 04 11:39:39.872087 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.872019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 11:39:39.872362 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.872054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 11:39:39.872362 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.872125    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 11:39:39.878383 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.878204    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 11:39:39.880583 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.879481    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df5f5fb7c-5hb4n"]
Aug 04 11:39:39.998615 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-console-config\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.999045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-trusted-ca-bundle\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.999045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-service-ca\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.999045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-oauth-serving-cert\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.999045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6g5\" (UniqueName: \"kubernetes.io/projected/a62f505a-94f9-44c9-8e04-84a43522bd12-kube-api-access-vf6g5\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.999045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a62f505a-94f9-44c9-8e04-84a43522bd12-console-oauth-config\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:39.999045 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:39.998879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a62f505a-94f9-44c9-8e04-84a43522bd12-console-serving-cert\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.099660 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.099543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a62f505a-94f9-44c9-8e04-84a43522bd12-console-serving-cert\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.099660 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.099596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-console-config\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.099923 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.099790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-trusted-ca-bundle\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.099923 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.099867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-service-ca\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.099923 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.099912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-oauth-serving-cert\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.100074 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.099962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6g5\" (UniqueName: \"kubernetes.io/projected/a62f505a-94f9-44c9-8e04-84a43522bd12-kube-api-access-vf6g5\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.100074 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.100005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a62f505a-94f9-44c9-8e04-84a43522bd12-console-oauth-config\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.100935 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.100321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-console-config\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.100935 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.100779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-trusted-ca-bundle\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.100935 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.100856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-oauth-serving-cert\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.100935 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.100907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a62f505a-94f9-44c9-8e04-84a43522bd12-service-ca\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.103870 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.103827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a62f505a-94f9-44c9-8e04-84a43522bd12-console-serving-cert\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.105088 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.105049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a62f505a-94f9-44c9-8e04-84a43522bd12-console-oauth-config\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.109821 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.109779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6g5\" (UniqueName: \"kubernetes.io/projected/a62f505a-94f9-44c9-8e04-84a43522bd12-kube-api-access-vf6g5\") pod \"console-df5f5fb7c-5hb4n\" (UID: \"a62f505a-94f9-44c9-8e04-84a43522bd12\") " pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:40.184145 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:40.184018    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:44.291526 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.291485    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:39:44.291902 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.291571    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:39:44.409162 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.409088    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df5f5fb7c-5hb4n"]
Aug 04 11:39:44.413020 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:44.412970    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62f505a_94f9_44c9_8e04_84a43522bd12.slice/crio-65316346b04e0e35970bff11fec5330966c25307a7065054e7879ab6ed3aeb87 WatchSource:0}: Error finding container 65316346b04e0e35970bff11fec5330966c25307a7065054e7879ab6ed3aeb87: Status 404 returned error can't find the container with id 65316346b04e0e35970bff11fec5330966c25307a7065054e7879ab6ed3aeb87
Aug 04 11:39:44.933136 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.933094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df5f5fb7c-5hb4n" event={"ID":"a62f505a-94f9-44c9-8e04-84a43522bd12","Type":"ContainerStarted","Data":"117ac5ff29690844ed1149548167544f1f891efd19e2a5705d991d0d07847e92"}
Aug 04 11:39:44.933344 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.933157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df5f5fb7c-5hb4n" event={"ID":"a62f505a-94f9-44c9-8e04-84a43522bd12","Type":"ContainerStarted","Data":"65316346b04e0e35970bff11fec5330966c25307a7065054e7879ab6ed3aeb87"}
Aug 04 11:39:44.934975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.934940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r" event={"ID":"21e96719-9d73-4341-a087-416ee32b90b1","Type":"ContainerStarted","Data":"93b0aff3bd7d8c606a127cff62bc4fcd2c93f3f4e4edbb2eec5ded4de178ac65"}
Aug 04 11:39:44.935547 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.935522    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:39:44.936942 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.936914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd" event={"ID":"3c1a7416-6d8e-4461-aca1-25cb07f7ab0f","Type":"ContainerStarted","Data":"1bea1bf967947fd806bb5f86dd5e5045c9ed2d4704cbfa19e7dea4b396add782"}
Aug 04 11:39:44.937383 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.937359    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:44.938998 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.938970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp" event={"ID":"89a28ef5-88cb-423e-8aa2-c4e03b648122","Type":"ContainerStarted","Data":"51bbc1ba3f8321afe47501709c3cc0e619e8d63fbd339e3f0d6ce1b3fd38e6a6"}
Aug 04 11:39:44.941111 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.941086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" event={"ID":"ec851247-fabf-4167-b5a6-3475b09575bd","Type":"ContainerStarted","Data":"267e34dbb9b3a4e98658faff2cc393350e1d40d6270789eb3c0aa0f4dfa495cd"}
Aug 04 11:39:44.941599 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.941577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:44.973904 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:44.973854    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-df5f5fb7c-5hb4n" podStartSLOduration=5.9738256849999996 podStartE2EDuration="5.973825685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:44.971321407 +0000 UTC m=+393.145807407" watchObservedRunningTime="2026-08-04 11:39:44.973825685 +0000 UTC m=+393.148311686"
Aug 04 11:39:45.000948 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:45.000888    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" podStartSLOduration=2.07790864 podStartE2EDuration="8.000874516s" totalImagesPullingTime="5.922965876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:44.999588746 +0000 UTC m=+393.174074749" watchObservedRunningTime="2026-08-04 11:39:45.000874516 +0000 UTC m=+393.175360518"
Aug 04 11:39:45.024135 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:45.024083    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd" podStartSLOduration=2.331412105 podStartE2EDuration="9.024067786s" totalImagesPullingTime="6.692655681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:45.022478274 +0000 UTC m=+393.196964277" watchObservedRunningTime="2026-08-04 11:39:45.024067786 +0000 UTC m=+393.198553787"
Aug 04 11:39:45.080688 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:45.080627    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-96bfd8458-fkkfp" podStartSLOduration=2.253389926 podStartE2EDuration="9.080605714s" totalImagesPullingTime="6.827215788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:45.077351889 +0000 UTC m=+393.251837912" watchObservedRunningTime="2026-08-04 11:39:45.080605714 +0000 UTC m=+393.255091715"
Aug 04 11:39:45.122125 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:45.122050    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r" podStartSLOduration=1.645685507 podStartE2EDuration="8.122028131s" totalImagesPullingTime="6.476342624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:45.118378304 +0000 UTC m=+393.292864309" watchObservedRunningTime="2026-08-04 11:39:45.122028131 +0000 UTC m=+393.296514135"
Aug 04 11:39:45.947823 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:45.947780    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-npxlj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:39:45.948184 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:45.947853    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:39:46.212309 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.212219    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"]
Aug 04 11:39:46.217431 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.216833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.220991 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.220961    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gdplw\""
Aug 04 11:39:46.240748 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.240717    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"]
Aug 04 11:39:46.361732 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.361732 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.361928 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02b7f11b-50d6-4032-9237-27c39446786c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.361928 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02b7f11b-50d6-4032-9237-27c39446786c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.361928 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdpnl\" (UniqueName: \"kubernetes.io/projected/02b7f11b-50d6-4032-9237-27c39446786c-kube-api-access-qdpnl\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.361928 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02b7f11b-50d6-4032-9237-27c39446786c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.362082 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.362082 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.361950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.362082 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.362006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.462866 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.462866 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02b7f11b-50d6-4032-9237-27c39446786c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.462866 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02b7f11b-50d6-4032-9237-27c39446786c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.462866 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpnl\" (UniqueName: \"kubernetes.io/projected/02b7f11b-50d6-4032-9237-27c39446786c-kube-api-access-qdpnl\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02b7f11b-50d6-4032-9237-27c39446786c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.462980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.463042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463440 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.463367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463555 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.463534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463613 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.463576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463660 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.463609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.463696 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.463653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02b7f11b-50d6-4032-9237-27c39446786c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.465322 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.465302    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02b7f11b-50d6-4032-9237-27c39446786c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.465690 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.465669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02b7f11b-50d6-4032-9237-27c39446786c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.477317 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.477284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdpnl\" (UniqueName: \"kubernetes.io/projected/02b7f11b-50d6-4032-9237-27c39446786c-kube-api-access-qdpnl\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.477680 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.477663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02b7f11b-50d6-4032-9237-27c39446786c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf\" (UID: \"02b7f11b-50d6-4032-9237-27c39446786c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.528911 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.528863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:39:46.666311 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.666289    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"]
Aug 04 11:39:46.668857 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:46.668828    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b7f11b_50d6_4032_9237_27c39446786c.slice/crio-af6459566933396e4e100faaa034b03794d0c414909993276e4cfdafde1570d0 WatchSource:0}: Error finding container af6459566933396e4e100faaa034b03794d0c414909993276e4cfdafde1570d0: Status 404 returned error can't find the container with id af6459566933396e4e100faaa034b03794d0c414909993276e4cfdafde1570d0
Aug 04 11:39:46.951702 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.951664    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf" event={"ID":"02b7f11b-50d6-4032-9237-27c39446786c","Type":"ContainerStarted","Data":"af6459566933396e4e100faaa034b03794d0c414909993276e4cfdafde1570d0"}
Aug 04 11:39:46.952473 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:46.952450    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:47.948132 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.948087    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"]
Aug 04 11:39:47.952737 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.952716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:47.954659 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.954633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wr5jf\""
Aug 04 11:39:47.954659 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.954638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 11:39:47.973602 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.973571    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"]
Aug 04 11:39:47.976728 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.976708    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"]
Aug 04 11:39:47.976860 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.976817    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:47.978855 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.978838    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 11:39:47.978958 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.978857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2xcm9\""
Aug 04 11:39:47.992120 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:47.992093    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"]
Aug 04 11:39:48.078380 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.078347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcxd\" (UniqueName: \"kubernetes.io/projected/120c24c5-c2ec-497a-ab1c-8a76b34ac829-kube-api-access-gqcxd\") pod \"kserve-controller-manager-d6f4b65b8-2gtzd\" (UID: \"120c24c5-c2ec-497a-ab1c-8a76b34ac829\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.078380 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.078379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/120c24c5-c2ec-497a-ab1c-8a76b34ac829-cert\") pod \"kserve-controller-manager-d6f4b65b8-2gtzd\" (UID: \"120c24c5-c2ec-497a-ab1c-8a76b34ac829\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.078649 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.078573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q9v2\" (UniqueName: \"kubernetes.io/projected/76773db6-360b-463b-bc1d-c7325e965e96-kube-api-access-9q9v2\") pod \"llmisvc-controller-manager-777c6bd7d5-j7w5q\" (UID: \"76773db6-360b-463b-bc1d-c7325e965e96\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.078706 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.078649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76773db6-360b-463b-bc1d-c7325e965e96-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7w5q\" (UID: \"76773db6-360b-463b-bc1d-c7325e965e96\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.180200 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.180163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcxd\" (UniqueName: \"kubernetes.io/projected/120c24c5-c2ec-497a-ab1c-8a76b34ac829-kube-api-access-gqcxd\") pod \"kserve-controller-manager-d6f4b65b8-2gtzd\" (UID: \"120c24c5-c2ec-497a-ab1c-8a76b34ac829\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.180383 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.180211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/120c24c5-c2ec-497a-ab1c-8a76b34ac829-cert\") pod \"kserve-controller-manager-d6f4b65b8-2gtzd\" (UID: \"120c24c5-c2ec-497a-ab1c-8a76b34ac829\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.180383 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.180286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q9v2\" (UniqueName: \"kubernetes.io/projected/76773db6-360b-463b-bc1d-c7325e965e96-kube-api-access-9q9v2\") pod \"llmisvc-controller-manager-777c6bd7d5-j7w5q\" (UID: \"76773db6-360b-463b-bc1d-c7325e965e96\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.180383 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.180326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76773db6-360b-463b-bc1d-c7325e965e96-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7w5q\" (UID: \"76773db6-360b-463b-bc1d-c7325e965e96\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.182793 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.182771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/120c24c5-c2ec-497a-ab1c-8a76b34ac829-cert\") pod \"kserve-controller-manager-d6f4b65b8-2gtzd\" (UID: \"120c24c5-c2ec-497a-ab1c-8a76b34ac829\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.182882 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.182820    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76773db6-360b-463b-bc1d-c7325e965e96-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j7w5q\" (UID: \"76773db6-360b-463b-bc1d-c7325e965e96\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.211657 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.211598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q9v2\" (UniqueName: \"kubernetes.io/projected/76773db6-360b-463b-bc1d-c7325e965e96-kube-api-access-9q9v2\") pod \"llmisvc-controller-manager-777c6bd7d5-j7w5q\" (UID: \"76773db6-360b-463b-bc1d-c7325e965e96\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.217279 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.217256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcxd\" (UniqueName: \"kubernetes.io/projected/120c24c5-c2ec-497a-ab1c-8a76b34ac829-kube-api-access-gqcxd\") pod \"kserve-controller-manager-d6f4b65b8-2gtzd\" (UID: \"120c24c5-c2ec-497a-ab1c-8a76b34ac829\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.266220 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.266192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:48.288135 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.288113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:48.445195 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.445164    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"]
Aug 04 11:39:48.449437 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:48.449395    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120c24c5_c2ec_497a_ab1c_8a76b34ac829.slice/crio-e59cdd6c0aeeb1391c3bb999362b9782a93ca194d64fd6c5fd7eb6306fc44a3e WatchSource:0}: Error finding container e59cdd6c0aeeb1391c3bb999362b9782a93ca194d64fd6c5fd7eb6306fc44a3e: Status 404 returned error can't find the container with id e59cdd6c0aeeb1391c3bb999362b9782a93ca194d64fd6c5fd7eb6306fc44a3e
Aug 04 11:39:48.467472 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.467438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"]
Aug 04 11:39:48.469924 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:39:48.469898    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76773db6_360b_463b_bc1d_c7325e965e96.slice/crio-99e2b181fd6731a36e7c90b57f5d51b3661629c0bc20306bd559db87cf4f6902 WatchSource:0}: Error finding container 99e2b181fd6731a36e7c90b57f5d51b3661629c0bc20306bd559db87cf4f6902: Status 404 returned error can't find the container with id 99e2b181fd6731a36e7c90b57f5d51b3661629c0bc20306bd559db87cf4f6902
Aug 04 11:39:48.962595 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.962563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd" event={"ID":"120c24c5-c2ec-497a-ab1c-8a76b34ac829","Type":"ContainerStarted","Data":"e59cdd6c0aeeb1391c3bb999362b9782a93ca194d64fd6c5fd7eb6306fc44a3e"}
Aug 04 11:39:48.963690 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:48.963667    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q" event={"ID":"76773db6-360b-463b-bc1d-c7325e965e96","Type":"ContainerStarted","Data":"99e2b181fd6731a36e7c90b57f5d51b3661629c0bc20306bd559db87cf4f6902"}
Aug 04 11:39:49.846817 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:49.846779    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"]
Aug 04 11:39:49.847055 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:49.846977    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" containerName="discovery" containerID="cri-o://267e34dbb9b3a4e98658faff2cc393350e1d40d6270789eb3c0aa0f4dfa495cd" gracePeriod=30
Aug 04 11:39:49.952295 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:49.952264    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-npxlj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.23:8080/ready\": dial tcp 10.134.0.23:8080: connect: connection refused" start-of-body=
Aug 04 11:39:49.952485 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:49.952322    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.23:8080/ready\": dial tcp 10.134.0.23:8080: connect: connection refused"
Aug 04 11:39:49.971228 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:49.971193    2582 generic.go:356] "Generic (PLEG): container finished" podID="ec851247-fabf-4167-b5a6-3475b09575bd" containerID="267e34dbb9b3a4e98658faff2cc393350e1d40d6270789eb3c0aa0f4dfa495cd" exitCode=0
Aug 04 11:39:49.971652 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:49.971240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" event={"ID":"ec851247-fabf-4167-b5a6-3475b09575bd","Type":"ContainerDied","Data":"267e34dbb9b3a4e98658faff2cc393350e1d40d6270789eb3c0aa0f4dfa495cd"}
Aug 04 11:39:50.110061 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.110003    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:50.185137 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.185099    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:50.185303 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.185193    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:50.190125 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.190098    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:50.199002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.198908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-kubeconfig\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.198961    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-cacerts\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199180 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.199018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec851247-fabf-4167-b5a6-3475b09575bd-local-certs\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199180 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.199160    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm87n\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-kube-api-access-hm87n\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199292 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.199218    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-ca-configmap\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199292 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.199279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-dns-cert\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199422 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.199311    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-istio-token\") pod \"ec851247-fabf-4167-b5a6-3475b09575bd\" (UID: \"ec851247-fabf-4167-b5a6-3475b09575bd\") "
Aug 04 11:39:50.199856 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.199813    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:39:50.201529 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.201500    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:39:50.201780 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.201748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-cacerts" (OuterVolumeSpecName: "cacerts") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:39:50.202270 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.202237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec851247-fabf-4167-b5a6-3475b09575bd-local-certs" (OuterVolumeSpecName: "local-certs") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:50.202342 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.202268    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:39:50.202625 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.202606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-kube-api-access-hm87n" (OuterVolumeSpecName: "kube-api-access-hm87n") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "kube-api-access-hm87n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:50.202825 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.202809    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec851247-fabf-4167-b5a6-3475b09575bd" (UID: "ec851247-fabf-4167-b5a6-3475b09575bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:50.301202 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301132    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec851247-fabf-4167-b5a6-3475b09575bd-local-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.301202 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301184    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm87n\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-kube-api-access-hm87n\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.301202 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301210    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-ca-configmap\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.301453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301224    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-csr-dns-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.301453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301236    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec851247-fabf-4167-b5a6-3475b09575bd-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.301453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301248    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-istio-kubeconfig\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.301453 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.301258    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec851247-fabf-4167-b5a6-3475b09575bd-cacerts\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:39:50.979314 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.979160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj" event={"ID":"ec851247-fabf-4167-b5a6-3475b09575bd","Type":"ContainerDied","Data":"50e0498b79d1c608e60af7013306dee9cebbcca4a4589ecb291ecfd412e92e02"}
Aug 04 11:39:50.979314 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.979201    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"
Aug 04 11:39:50.979314 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.979244    2582 scope.go:117] "RemoveContainer" containerID="267e34dbb9b3a4e98658faff2cc393350e1d40d6270789eb3c0aa0f4dfa495cd"
Aug 04 11:39:50.984907 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:50.984865    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-df5f5fb7c-5hb4n"
Aug 04 11:39:51.003106 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:51.003072    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"]
Aug 04 11:39:51.007576 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:51.007549    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-npxlj"]
Aug 04 11:39:52.350353 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:52.350324    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" path="/var/lib/kubelet/pods/ec851247-fabf-4167-b5a6-3475b09575bd/volumes"
Aug 04 11:39:52.991586 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:52.991550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd" event={"ID":"120c24c5-c2ec-497a-ab1c-8a76b34ac829","Type":"ContainerStarted","Data":"d98602855138b9e9d45811ed6d3b0280c1c9c6dea4eeebf39319c3a7658c8dd9"}
Aug 04 11:39:52.991778 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:52.991720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:39:52.993052 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:52.993031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q" event={"ID":"76773db6-360b-463b-bc1d-c7325e965e96","Type":"ContainerStarted","Data":"1435c8acefefe97a53d5a3de5ef45327b75cf16cdd8c7bc0e8c3c5bc97a65588"}
Aug 04 11:39:52.993153 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:52.993112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:39:53.009944 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:53.009893    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd" podStartSLOduration=2.288813026 podStartE2EDuration="6.009878235s" totalImagesPullingTime="3.721065209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:53.008949633 +0000 UTC m=+401.183435634" watchObservedRunningTime="2026-08-04 11:39:53.009878235 +0000 UTC m=+401.184364237"
Aug 04 11:39:53.026101 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:53.026034    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q" podStartSLOduration=2.272289115 podStartE2EDuration="6.026016146s" totalImagesPullingTime="3.753727031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:39:53.024168631 +0000 UTC m=+401.198654635" watchObservedRunningTime="2026-08-04 11:39:53.026016146 +0000 UTC m=+401.200502149"
Aug 04 11:39:56.953749 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:56.953716    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fdcnd"
Aug 04 11:39:56.957578 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:39:56.957552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ck56r"
Aug 04 11:40:03.412063 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:03.412024    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:40:03.412347 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:03.412108    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:40:03.412347 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:03.412138    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:40:04.042972 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:04.042934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf" event={"ID":"02b7f11b-50d6-4032-9237-27c39446786c","Type":"ContainerStarted","Data":"1ce8d45568f88b7608fbb8b1e8b207653fae7d78c135d490f07df10cc120f80e"}
Aug 04 11:40:04.062458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:04.062389    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf" podStartSLOduration=1.3216953359999999 podStartE2EDuration="18.062373408s" totalImagesPullingTime="16.740678072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:04.061342783 +0000 UTC m=+412.235828785" watchObservedRunningTime="2026-08-04 11:40:04.062373408 +0000 UTC m=+412.236859410"
Aug 04 11:40:04.529309 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:04.529270    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:40:04.534177 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:04.534148    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:40:05.047077 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:05.047047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:40:05.048089 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:05.048065    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf"
Aug 04 11:40:24.000165 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:24.000129    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j7w5q"
Aug 04 11:40:24.003089 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:24.003065    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2gtzd"
Aug 04 11:40:30.543251 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.543218    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"]
Aug 04 11:40:30.543652 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.543584    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" containerName="discovery"
Aug 04 11:40:30.543652 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.543597    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" containerName="discovery"
Aug 04 11:40:30.543778 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.543670    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec851247-fabf-4167-b5a6-3475b09575bd" containerName="discovery"
Aug 04 11:40:30.554727 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.554688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.555496 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.555472    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"]
Aug 04 11:40:30.557356 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.557248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vxtl\""
Aug 04 11:40:30.557556 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.557354    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 11:40:30.557556 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.557492    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 11:40:30.643527 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.643485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.643527 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.643530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwj9\" (UniqueName: \"kubernetes.io/projected/4a3ef246-fc31-4cc1-9124-856e477266eb-kube-api-access-lhwj9\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.643754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.643567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.651266 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.651232    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"]
Aug 04 11:40:30.653751 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.653735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.670438 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.670391    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"]
Aug 04 11:40:30.744544 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.744506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.744766 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.744550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwj9\" (UniqueName: \"kubernetes.io/projected/4a3ef246-fc31-4cc1-9124-856e477266eb-kube-api-access-lhwj9\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.744766 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.744609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.744766 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.744654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.744766 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.744692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.744955 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.744871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxltv\" (UniqueName: \"kubernetes.io/projected/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-kube-api-access-xxltv\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.745081 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.745063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.745116 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.745071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.749655 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.749631    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"]
Aug 04 11:40:30.751947 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.751928    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.753718 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.753698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwj9\" (UniqueName: \"kubernetes.io/projected/4a3ef246-fc31-4cc1-9124-856e477266eb-kube-api-access-lhwj9\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.768822 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.768798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"]
Aug 04 11:40:30.842283 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.842206    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"]
Aug 04 11:40:30.844703 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.844687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:30.845871 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.845848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.845944 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.845927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxltv\" (UniqueName: \"kubernetes.io/projected/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-kube-api-access-xxltv\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.845986 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.845965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.846061 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.846046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.846112 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.846075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.846112 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.846098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxwf\" (UniqueName: \"kubernetes.io/projected/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-kube-api-access-pzxwf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.846229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.846162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.846325 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.846307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.858902 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.858878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"]
Aug 04 11:40:30.863619 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.863589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxltv\" (UniqueName: \"kubernetes.io/projected/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-kube-api-access-xxltv\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:30.867286 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.867265    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:30.946881 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.946787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.946881 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.946832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:30.948027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.946976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zxf\" (UniqueName: \"kubernetes.io/projected/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-kube-api-access-f5zxf\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:30.948027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.947020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.948027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.947053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxwf\" (UniqueName: \"kubernetes.io/projected/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-kube-api-access-pzxwf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.948027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.947093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:30.948027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.947204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.948027 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.947453    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.956947 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.956924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxwf\" (UniqueName: \"kubernetes.io/projected/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-kube-api-access-pzxwf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:30.962793 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:30.962771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:31.003330 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.003307    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"]
Aug 04 11:40:31.005136 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:31.005104    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3ef246_fc31_4cc1_9124_856e477266eb.slice/crio-340a52189f52df1dcf8e1a03db93f4a44459e5d0fcdb351fea408467eadf239f WatchSource:0}: Error finding container 340a52189f52df1dcf8e1a03db93f4a44459e5d0fcdb351fea408467eadf239f: Status 404 returned error can't find the container with id 340a52189f52df1dcf8e1a03db93f4a44459e5d0fcdb351fea408467eadf239f
Aug 04 11:40:31.048049 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.048015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zxf\" (UniqueName: \"kubernetes.io/projected/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-kube-api-access-f5zxf\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.048169 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.048072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.048169 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.048153    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.048610 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.048579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.048711 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.048647    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.059271 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.059243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zxf\" (UniqueName: \"kubernetes.io/projected/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-kube-api-access-f5zxf\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.067133 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.067108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:31.102110 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.102082    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"]
Aug 04 11:40:31.103908 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:31.103873    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95d5855_49cd_4417_98c5_d9ca03b2ef6a.slice/crio-acefec35b5b63d213bae0768c243eac1ec4967e3d17a553b9e94252b00c42f42 WatchSource:0}: Error finding container acefec35b5b63d213bae0768c243eac1ec4967e3d17a553b9e94252b00c42f42: Status 404 returned error can't find the container with id acefec35b5b63d213bae0768c243eac1ec4967e3d17a553b9e94252b00c42f42
Aug 04 11:40:31.154136 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.153613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:31.166691 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.166669    2582 generic.go:356] "Generic (PLEG): container finished" podID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerID="6f8c1ae8a93d05b5796a76a1a52d31dc0ad1570d7e0e4f18d2cb707898646a45" exitCode=0
Aug 04 11:40:31.166759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.166704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q" event={"ID":"4a3ef246-fc31-4cc1-9124-856e477266eb","Type":"ContainerDied","Data":"6f8c1ae8a93d05b5796a76a1a52d31dc0ad1570d7e0e4f18d2cb707898646a45"}
Aug 04 11:40:31.166813 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.166760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q" event={"ID":"4a3ef246-fc31-4cc1-9124-856e477266eb","Type":"ContainerStarted","Data":"340a52189f52df1dcf8e1a03db93f4a44459e5d0fcdb351fea408467eadf239f"}
Aug 04 11:40:31.168838 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.168799    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898" event={"ID":"e95d5855-49cd-4417-98c5-d9ca03b2ef6a","Type":"ContainerStarted","Data":"acefec35b5b63d213bae0768c243eac1ec4967e3d17a553b9e94252b00c42f42"}
Aug 04 11:40:31.215639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.215561    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"]
Aug 04 11:40:31.220505 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:31.220459    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8223fa05_756d_4a53_acd6_ecd7c9e9b4dc.slice/crio-79d489160dd130becf0c3df53d9892c39d1e63f5e2e23c191713211ba67821bc WatchSource:0}: Error finding container 79d489160dd130becf0c3df53d9892c39d1e63f5e2e23c191713211ba67821bc: Status 404 returned error can't find the container with id 79d489160dd130becf0c3df53d9892c39d1e63f5e2e23c191713211ba67821bc
Aug 04 11:40:31.295782 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:31.295754    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"]
Aug 04 11:40:31.306099 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:31.306070    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b2ce9b_6e96_4f96_859a_620fc8b75ecc.slice/crio-526e02af8a53a4966c95c1a62d47d3b2c26904f6dd2aebcd453aa5f00bb0f351 WatchSource:0}: Error finding container 526e02af8a53a4966c95c1a62d47d3b2c26904f6dd2aebcd453aa5f00bb0f351: Status 404 returned error can't find the container with id 526e02af8a53a4966c95c1a62d47d3b2c26904f6dd2aebcd453aa5f00bb0f351
Aug 04 11:40:32.175118 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.175041    2582 generic.go:356] "Generic (PLEG): container finished" podID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerID="cef10c265353ddec558848495d5645289fd4663de385eff3da13216bdb33a22a" exitCode=0
Aug 04 11:40:32.175118 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.175114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898" event={"ID":"e95d5855-49cd-4417-98c5-d9ca03b2ef6a","Type":"ContainerDied","Data":"cef10c265353ddec558848495d5645289fd4663de385eff3da13216bdb33a22a"}
Aug 04 11:40:32.179811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.179787    2582 generic.go:356] "Generic (PLEG): container finished" podID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerID="bff7978cff6d4ceaf874063c71ac6d5d9e421c5861b8c27be6206b1c9d3ce9e8" exitCode=0
Aug 04 11:40:32.179939 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.179848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7" event={"ID":"29b2ce9b-6e96-4f96-859a-620fc8b75ecc","Type":"ContainerDied","Data":"bff7978cff6d4ceaf874063c71ac6d5d9e421c5861b8c27be6206b1c9d3ce9e8"}
Aug 04 11:40:32.179939 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.179910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7" event={"ID":"29b2ce9b-6e96-4f96-859a-620fc8b75ecc","Type":"ContainerStarted","Data":"526e02af8a53a4966c95c1a62d47d3b2c26904f6dd2aebcd453aa5f00bb0f351"}
Aug 04 11:40:32.181667 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.181645    2582 generic.go:356] "Generic (PLEG): container finished" podID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerID="952139b480e3f9b6a2632d3f9d3fe906babdc7fdcdcfab66ec4f049167ba823a" exitCode=0
Aug 04 11:40:32.181767 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.181681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q" event={"ID":"4a3ef246-fc31-4cc1-9124-856e477266eb","Type":"ContainerDied","Data":"952139b480e3f9b6a2632d3f9d3fe906babdc7fdcdcfab66ec4f049167ba823a"}
Aug 04 11:40:32.183726 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.183658    2582 generic.go:356] "Generic (PLEG): container finished" podID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerID="c1e2dc8267bc597f60c823203c7c260e7dfb4d5ae55110063bcb775ca0e23dd5" exitCode=0
Aug 04 11:40:32.183726 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.183688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf" event={"ID":"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc","Type":"ContainerDied","Data":"c1e2dc8267bc597f60c823203c7c260e7dfb4d5ae55110063bcb775ca0e23dd5"}
Aug 04 11:40:32.183726 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:32.183714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf" event={"ID":"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc","Type":"ContainerStarted","Data":"79d489160dd130becf0c3df53d9892c39d1e63f5e2e23c191713211ba67821bc"}
Aug 04 11:40:33.193808 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:33.193775    2582 generic.go:356] "Generic (PLEG): container finished" podID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerID="3a4f5cf41c13be2ff88c4a1a7c2bc697967ecc10de5790d0243f8e806ae342bc" exitCode=0
Aug 04 11:40:33.194113 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:33.193849    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q" event={"ID":"4a3ef246-fc31-4cc1-9124-856e477266eb","Type":"ContainerDied","Data":"3a4f5cf41c13be2ff88c4a1a7c2bc697967ecc10de5790d0243f8e806ae342bc"}
Aug 04 11:40:34.200468 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.200378    2582 generic.go:356] "Generic (PLEG): container finished" podID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerID="d6be9c56058961558ebf109034393f6403d17d4126762a1f7d12280fb9c6d9ac" exitCode=0
Aug 04 11:40:34.200889 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.200478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898" event={"ID":"e95d5855-49cd-4417-98c5-d9ca03b2ef6a","Type":"ContainerDied","Data":"d6be9c56058961558ebf109034393f6403d17d4126762a1f7d12280fb9c6d9ac"}
Aug 04 11:40:34.202379 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.202358    2582 generic.go:356] "Generic (PLEG): container finished" podID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerID="5760f6ff70e8f003abe92c0565588ab890f6c452b4618f2e0807e3dc2584d806" exitCode=0
Aug 04 11:40:34.202483 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.202444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf" event={"ID":"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc","Type":"ContainerDied","Data":"5760f6ff70e8f003abe92c0565588ab890f6c452b4618f2e0807e3dc2584d806"}
Aug 04 11:40:34.346655 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.346625    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:34.480030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.479947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-util\") pod \"4a3ef246-fc31-4cc1-9124-856e477266eb\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") "
Aug 04 11:40:34.480030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.479985    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhwj9\" (UniqueName: \"kubernetes.io/projected/4a3ef246-fc31-4cc1-9124-856e477266eb-kube-api-access-lhwj9\") pod \"4a3ef246-fc31-4cc1-9124-856e477266eb\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") "
Aug 04 11:40:34.480229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.480057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-bundle\") pod \"4a3ef246-fc31-4cc1-9124-856e477266eb\" (UID: \"4a3ef246-fc31-4cc1-9124-856e477266eb\") "
Aug 04 11:40:34.480765 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.480740    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-bundle" (OuterVolumeSpecName: "bundle") pod "4a3ef246-fc31-4cc1-9124-856e477266eb" (UID: "4a3ef246-fc31-4cc1-9124-856e477266eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:34.482052 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.482026    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3ef246-fc31-4cc1-9124-856e477266eb-kube-api-access-lhwj9" (OuterVolumeSpecName: "kube-api-access-lhwj9") pod "4a3ef246-fc31-4cc1-9124-856e477266eb" (UID: "4a3ef246-fc31-4cc1-9124-856e477266eb"). InnerVolumeSpecName "kube-api-access-lhwj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:40:34.485920 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.485890    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-util" (OuterVolumeSpecName: "util") pod "4a3ef246-fc31-4cc1-9124-856e477266eb" (UID: "4a3ef246-fc31-4cc1-9124-856e477266eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:34.581435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.581382    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:34.581435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.581433    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhwj9\" (UniqueName: \"kubernetes.io/projected/4a3ef246-fc31-4cc1-9124-856e477266eb-kube-api-access-lhwj9\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:34.581435 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:34.581443    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3ef246-fc31-4cc1-9124-856e477266eb-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:35.208509 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.208475    2582 generic.go:356] "Generic (PLEG): container finished" podID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerID="abe267d4a4bb4ec487799cfd745b2051a9c02d4bc5a72d0a548969bda939ba20" exitCode=0
Aug 04 11:40:35.208907 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.208572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898" event={"ID":"e95d5855-49cd-4417-98c5-d9ca03b2ef6a","Type":"ContainerDied","Data":"abe267d4a4bb4ec487799cfd745b2051a9c02d4bc5a72d0a548969bda939ba20"}
Aug 04 11:40:35.210332 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.210307    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q"
Aug 04 11:40:35.210458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.210354    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053c5n4q" event={"ID":"4a3ef246-fc31-4cc1-9124-856e477266eb","Type":"ContainerDied","Data":"340a52189f52df1dcf8e1a03db93f4a44459e5d0fcdb351fea408467eadf239f"}
Aug 04 11:40:35.210458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.210400    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="340a52189f52df1dcf8e1a03db93f4a44459e5d0fcdb351fea408467eadf239f"
Aug 04 11:40:35.212615 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.212595    2582 generic.go:356] "Generic (PLEG): container finished" podID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerID="118f9f6fde32e9b347c130a4973d66a11f54bbb85abb77398bab909b13b53606" exitCode=0
Aug 04 11:40:35.212706 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:35.212621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf" event={"ID":"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc","Type":"ContainerDied","Data":"118f9f6fde32e9b347c130a4973d66a11f54bbb85abb77398bab909b13b53606"}
Aug 04 11:40:36.363466 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.363444    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:36.365869 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.365847    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:36.496900 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.496819    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxltv\" (UniqueName: \"kubernetes.io/projected/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-kube-api-access-xxltv\") pod \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") "
Aug 04 11:40:36.496900 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.496875    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-util\") pod \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") "
Aug 04 11:40:36.496900 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.496894    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-util\") pod \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") "
Aug 04 11:40:36.497122 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.496923    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-bundle\") pod \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") "
Aug 04 11:40:36.497122 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.496957    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxwf\" (UniqueName: \"kubernetes.io/projected/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-kube-api-access-pzxwf\") pod \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\" (UID: \"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc\") "
Aug 04 11:40:36.497122 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.497017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-bundle\") pod \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\" (UID: \"e95d5855-49cd-4417-98c5-d9ca03b2ef6a\") "
Aug 04 11:40:36.497586 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.497542    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-bundle" (OuterVolumeSpecName: "bundle") pod "8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" (UID: "8223fa05-756d-4a53-acd6-ecd7c9e9b4dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:36.497728 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.497694    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-bundle" (OuterVolumeSpecName: "bundle") pod "e95d5855-49cd-4417-98c5-d9ca03b2ef6a" (UID: "e95d5855-49cd-4417-98c5-d9ca03b2ef6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:36.499084 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.499060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-kube-api-access-xxltv" (OuterVolumeSpecName: "kube-api-access-xxltv") pod "e95d5855-49cd-4417-98c5-d9ca03b2ef6a" (UID: "e95d5855-49cd-4417-98c5-d9ca03b2ef6a"). InnerVolumeSpecName "kube-api-access-xxltv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:40:36.499176 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.499090    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-kube-api-access-pzxwf" (OuterVolumeSpecName: "kube-api-access-pzxwf") pod "8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" (UID: "8223fa05-756d-4a53-acd6-ecd7c9e9b4dc"). InnerVolumeSpecName "kube-api-access-pzxwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:40:36.504450 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.504421    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-util" (OuterVolumeSpecName: "util") pod "e95d5855-49cd-4417-98c5-d9ca03b2ef6a" (UID: "e95d5855-49cd-4417-98c5-d9ca03b2ef6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:36.504751 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.504735    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-util" (OuterVolumeSpecName: "util") pod "8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" (UID: "8223fa05-756d-4a53-acd6-ecd7c9e9b4dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:36.598641 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.598611    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:36.598641 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.598637    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxwf\" (UniqueName: \"kubernetes.io/projected/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-kube-api-access-pzxwf\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:36.598641 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.598648    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:36.598832 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.598657    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxltv\" (UniqueName: \"kubernetes.io/projected/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-kube-api-access-xxltv\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:36.598832 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.598665    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8223fa05-756d-4a53-acd6-ecd7c9e9b4dc-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:36.598832 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:36.598673    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e95d5855-49cd-4417-98c5-d9ca03b2ef6a-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:37.224196 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:37.224167    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898"
Aug 04 11:40:37.224355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:37.224190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cvp898" event={"ID":"e95d5855-49cd-4417-98c5-d9ca03b2ef6a","Type":"ContainerDied","Data":"acefec35b5b63d213bae0768c243eac1ec4967e3d17a553b9e94252b00c42f42"}
Aug 04 11:40:37.224355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:37.224258    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acefec35b5b63d213bae0768c243eac1ec4967e3d17a553b9e94252b00c42f42"
Aug 04 11:40:37.226040 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:37.226022    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf"
Aug 04 11:40:37.226040 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:37.226029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbljlcf" event={"ID":"8223fa05-756d-4a53-acd6-ecd7c9e9b4dc","Type":"ContainerDied","Data":"79d489160dd130becf0c3df53d9892c39d1e63f5e2e23c191713211ba67821bc"}
Aug 04 11:40:37.226174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:37.226067    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79d489160dd130becf0c3df53d9892c39d1e63f5e2e23c191713211ba67821bc"
Aug 04 11:40:38.232321 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:38.232288    2582 generic.go:356] "Generic (PLEG): container finished" podID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerID="9033d63f9bc543210be33206b8d4ea8b1fed19a54750dd18f7fb62ffd8d0ae9b" exitCode=0
Aug 04 11:40:38.232723 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:38.232352    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7" event={"ID":"29b2ce9b-6e96-4f96-859a-620fc8b75ecc","Type":"ContainerDied","Data":"9033d63f9bc543210be33206b8d4ea8b1fed19a54750dd18f7fb62ffd8d0ae9b"}
Aug 04 11:40:39.239366 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:39.239332    2582 generic.go:356] "Generic (PLEG): container finished" podID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerID="ea2588df2e76aa77946ddaf08c16c3d9dc4c2eae60db323e6da54e7b5aea5a95" exitCode=0
Aug 04 11:40:39.239822 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:39.239386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7" event={"ID":"29b2ce9b-6e96-4f96-859a-620fc8b75ecc","Type":"ContainerDied","Data":"ea2588df2e76aa77946ddaf08c16c3d9dc4c2eae60db323e6da54e7b5aea5a95"}
Aug 04 11:40:40.374548 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.374522    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:40.533888 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.533798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-util\") pod \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") "
Aug 04 11:40:40.534040 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.533910    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5zxf\" (UniqueName: \"kubernetes.io/projected/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-kube-api-access-f5zxf\") pod \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") "
Aug 04 11:40:40.534040 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.533958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-bundle\") pod \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\" (UID: \"29b2ce9b-6e96-4f96-859a-620fc8b75ecc\") "
Aug 04 11:40:40.534446 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.534389    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-bundle" (OuterVolumeSpecName: "bundle") pod "29b2ce9b-6e96-4f96-859a-620fc8b75ecc" (UID: "29b2ce9b-6e96-4f96-859a-620fc8b75ecc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:40.535996 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.535971    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-kube-api-access-f5zxf" (OuterVolumeSpecName: "kube-api-access-f5zxf") pod "29b2ce9b-6e96-4f96-859a-620fc8b75ecc" (UID: "29b2ce9b-6e96-4f96-859a-620fc8b75ecc"). InnerVolumeSpecName "kube-api-access-f5zxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:40:40.538242 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.538222    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-util" (OuterVolumeSpecName: "util") pod "29b2ce9b-6e96-4f96-859a-620fc8b75ecc" (UID: "29b2ce9b-6e96-4f96-859a-620fc8b75ecc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:40.634610 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.634569    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5zxf\" (UniqueName: \"kubernetes.io/projected/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-kube-api-access-f5zxf\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:40.634610 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.634602    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:40.634610 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:40.634616    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b2ce9b-6e96-4f96-859a-620fc8b75ecc-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:40:41.251457 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:41.251426    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7"
Aug 04 11:40:41.251633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:41.251427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08lfl7" event={"ID":"29b2ce9b-6e96-4f96-859a-620fc8b75ecc","Type":"ContainerDied","Data":"526e02af8a53a4966c95c1a62d47d3b2c26904f6dd2aebcd453aa5f00bb0f351"}
Aug 04 11:40:41.251633 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:41.251553    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="526e02af8a53a4966c95c1a62d47d3b2c26904f6dd2aebcd453aa5f00bb0f351"
Aug 04 11:40:47.390366 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390333    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-75z7t"]
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390655    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="extract"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390666    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="extract"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390676    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390682    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390689    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390694    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390707    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="pull"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390713    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="pull"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390721    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="pull"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390726    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="pull"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390733    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390738    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390747    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390752    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="util"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390758    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="pull"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390763    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="pull"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390769    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="extract"
Aug 04 11:40:47.390769 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390774    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390781    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="pull"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390786    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="pull"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390791    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390796    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390804    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390809    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390856    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3ef246-fc31-4cc1-9124-856e477266eb" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390865    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8223fa05-756d-4a53-acd6-ecd7c9e9b4dc" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390871    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b2ce9b-6e96-4f96-859a-620fc8b75ecc" containerName="extract"
Aug 04 11:40:47.391272 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.390879    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e95d5855-49cd-4417-98c5-d9ca03b2ef6a" containerName="extract"
Aug 04 11:40:47.393951 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.393934    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:40:47.396060 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.396033    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 11:40:47.396060 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.396047    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 11:40:47.396221 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.396068    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k74fq\""
Aug 04 11:40:47.404020 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.403996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-75z7t"]
Aug 04 11:40:47.492778 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.492741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66fpl\" (UniqueName: \"kubernetes.io/projected/c7f307e7-19f1-4311-8e1a-b13966512533-kube-api-access-66fpl\") pod \"authorino-operator-68d88948d8-75z7t\" (UID: \"c7f307e7-19f1-4311-8e1a-b13966512533\") " pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:40:47.593935 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.593902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66fpl\" (UniqueName: \"kubernetes.io/projected/c7f307e7-19f1-4311-8e1a-b13966512533-kube-api-access-66fpl\") pod \"authorino-operator-68d88948d8-75z7t\" (UID: \"c7f307e7-19f1-4311-8e1a-b13966512533\") " pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:40:47.603455 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.603426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66fpl\" (UniqueName: \"kubernetes.io/projected/c7f307e7-19f1-4311-8e1a-b13966512533-kube-api-access-66fpl\") pod \"authorino-operator-68d88948d8-75z7t\" (UID: \"c7f307e7-19f1-4311-8e1a-b13966512533\") " pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:40:47.704558 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.704475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:40:47.841878 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:47.841852    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-75z7t"]
Aug 04 11:40:47.843712 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:47.843682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f307e7_19f1_4311_8e1a_b13966512533.slice/crio-d7bb7f9c75c3632ea2b9f5d02f4604d2ec0787a67749f460cf672e2bca61f93b WatchSource:0}: Error finding container d7bb7f9c75c3632ea2b9f5d02f4604d2ec0787a67749f460cf672e2bca61f93b: Status 404 returned error can't find the container with id d7bb7f9c75c3632ea2b9f5d02f4604d2ec0787a67749f460cf672e2bca61f93b
Aug 04 11:40:48.284132 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:48.284096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t" event={"ID":"c7f307e7-19f1-4311-8e1a-b13966512533","Type":"ContainerStarted","Data":"d7bb7f9c75c3632ea2b9f5d02f4604d2ec0787a67749f460cf672e2bca61f93b"}
Aug 04 11:40:51.303609 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.303527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t" event={"ID":"c7f307e7-19f1-4311-8e1a-b13966512533","Type":"ContainerStarted","Data":"3b8cec62aad3b00ae7f633dc87d65e8003fbcc8eb298e3fd0174f9b2ab02244f"}
Aug 04 11:40:51.303968 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.303635    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:40:51.319860 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.319804    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t" podStartSLOduration=1.819036136 podStartE2EDuration="4.319789467s" totalImagesPullingTime="2.500753331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:51.318801709 +0000 UTC m=+459.493287713" watchObservedRunningTime="2026-08-04 11:40:51.319789467 +0000 UTC m=+459.494275469"
Aug 04 11:40:51.712727 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.712688    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"]
Aug 04 11:40:51.716103 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.716086    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:51.718074 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.718047    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t66lf\""
Aug 04 11:40:51.735470 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.735428    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"]
Aug 04 11:40:51.834430 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.834362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3af5e807-6899-424d-b250-6efec8fb8db5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:51.834606 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.834442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsx8m\" (UniqueName: \"kubernetes.io/projected/3af5e807-6899-424d-b250-6efec8fb8db5-kube-api-access-vsx8m\") pod \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:51.934985 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.934946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3af5e807-6899-424d-b250-6efec8fb8db5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:51.934985 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.934990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsx8m\" (UniqueName: \"kubernetes.io/projected/3af5e807-6899-424d-b250-6efec8fb8db5-kube-api-access-vsx8m\") pod \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:51.935375 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.935351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3af5e807-6899-424d-b250-6efec8fb8db5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:51.949502 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:51.949479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsx8m\" (UniqueName: \"kubernetes.io/projected/3af5e807-6899-424d-b250-6efec8fb8db5-kube-api-access-vsx8m\") pod \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:52.026159 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:52.026071    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:52.171060 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:52.171035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"]
Aug 04 11:40:52.173921 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:52.173889    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af5e807_6899_424d_b250_6efec8fb8db5.slice/crio-3744f2e3f6eb5ff00bb1a10bb62d6d338b14baf1207e089b46046af76024eeec WatchSource:0}: Error finding container 3744f2e3f6eb5ff00bb1a10bb62d6d338b14baf1207e089b46046af76024eeec: Status 404 returned error can't find the container with id 3744f2e3f6eb5ff00bb1a10bb62d6d338b14baf1207e089b46046af76024eeec
Aug 04 11:40:52.310145 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:52.310053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn" event={"ID":"3af5e807-6899-424d-b250-6efec8fb8db5","Type":"ContainerStarted","Data":"3744f2e3f6eb5ff00bb1a10bb62d6d338b14baf1207e089b46046af76024eeec"}
Aug 04 11:40:54.140141 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.140110    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"]
Aug 04 11:40:54.143660 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.143637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:40:54.145994 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.145973    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 04 11:40:54.146129 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.146105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9vc7v\""
Aug 04 11:40:54.159139 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.159115    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"]
Aug 04 11:40:54.253381 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.253337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpgq\" (UniqueName: \"kubernetes.io/projected/58ab00c5-c50c-48f8-b18c-ca9323002879-kube-api-access-twpgq\") pod \"dns-operator-controller-manager-5985564776-5s7v4\" (UID: \"58ab00c5-c50c-48f8-b18c-ca9323002879\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:40:54.354075 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.354035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twpgq\" (UniqueName: \"kubernetes.io/projected/58ab00c5-c50c-48f8-b18c-ca9323002879-kube-api-access-twpgq\") pod \"dns-operator-controller-manager-5985564776-5s7v4\" (UID: \"58ab00c5-c50c-48f8-b18c-ca9323002879\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:40:54.364024 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.363994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpgq\" (UniqueName: \"kubernetes.io/projected/58ab00c5-c50c-48f8-b18c-ca9323002879-kube-api-access-twpgq\") pod \"dns-operator-controller-manager-5985564776-5s7v4\" (UID: \"58ab00c5-c50c-48f8-b18c-ca9323002879\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:40:54.458295 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.458206    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:40:54.620380 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:54.620258    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"]
Aug 04 11:40:54.623259 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:54.623227    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ab00c5_c50c_48f8_b18c_ca9323002879.slice/crio-100348cac6d902840b6eb8a05b8b909a1f0041ebbdada4021331ce72ee1cdf1a WatchSource:0}: Error finding container 100348cac6d902840b6eb8a05b8b909a1f0041ebbdada4021331ce72ee1cdf1a: Status 404 returned error can't find the container with id 100348cac6d902840b6eb8a05b8b909a1f0041ebbdada4021331ce72ee1cdf1a
Aug 04 11:40:55.329713 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:55.329675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4" event={"ID":"58ab00c5-c50c-48f8-b18c-ca9323002879","Type":"ContainerStarted","Data":"100348cac6d902840b6eb8a05b8b909a1f0041ebbdada4021331ce72ee1cdf1a"}
Aug 04 11:40:56.046030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.045969    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"]
Aug 04 11:40:56.049811 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.049783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:40:56.052926 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.052829    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n6fh6\""
Aug 04 11:40:56.061080 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.061052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"]
Aug 04 11:40:56.171261 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.171175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6qdb\" (UniqueName: \"kubernetes.io/projected/7fee3bb2-8e48-42d3-9164-aa6151d18b76-kube-api-access-b6qdb\") pod \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" (UID: \"7fee3bb2-8e48-42d3-9164-aa6151d18b76\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:40:56.272152 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.272113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qdb\" (UniqueName: \"kubernetes.io/projected/7fee3bb2-8e48-42d3-9164-aa6151d18b76-kube-api-access-b6qdb\") pod \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" (UID: \"7fee3bb2-8e48-42d3-9164-aa6151d18b76\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:40:56.281106 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.281077    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6qdb\" (UniqueName: \"kubernetes.io/projected/7fee3bb2-8e48-42d3-9164-aa6151d18b76-kube-api-access-b6qdb\") pod \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" (UID: \"7fee3bb2-8e48-42d3-9164-aa6151d18b76\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:40:56.337335 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.337298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn" event={"ID":"3af5e807-6899-424d-b250-6efec8fb8db5","Type":"ContainerStarted","Data":"e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259"}
Aug 04 11:40:56.337804 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.337457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:40:56.362477 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.362449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:40:56.368069 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.368017    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn" podStartSLOduration=1.6251531849999998 podStartE2EDuration="5.367995397s" totalImagesPullingTime="3.742842212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:56.367052741 +0000 UTC m=+464.541538744" watchObservedRunningTime="2026-08-04 11:40:56.367995397 +0000 UTC m=+464.542481402"
Aug 04 11:40:56.510972 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:56.510949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"]
Aug 04 11:40:56.782861 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:40:56.782789    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fee3bb2_8e48_42d3_9164_aa6151d18b76.slice/crio-34a190d5e6911d69515930daf9fbccb2d71d2f265df8eb2e7e43b855334912b5 WatchSource:0}: Error finding container 34a190d5e6911d69515930daf9fbccb2d71d2f265df8eb2e7e43b855334912b5: Status 404 returned error can't find the container with id 34a190d5e6911d69515930daf9fbccb2d71d2f265df8eb2e7e43b855334912b5
Aug 04 11:40:57.344717 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:57.344673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4" event={"ID":"58ab00c5-c50c-48f8-b18c-ca9323002879","Type":"ContainerStarted","Data":"3d2f0dc77573cc993dc178beab0c18e7ae0316c5df4dabfe551cd2e49df7931a"}
Aug 04 11:40:57.345173 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:57.344741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:40:57.345969 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:57.345945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2" event={"ID":"7fee3bb2-8e48-42d3-9164-aa6151d18b76","Type":"ContainerStarted","Data":"34a190d5e6911d69515930daf9fbccb2d71d2f265df8eb2e7e43b855334912b5"}
Aug 04 11:40:57.362545 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:57.362498    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4" podStartSLOduration=1.145328554 podStartE2EDuration="3.362484263s" totalImagesPullingTime="2.217155709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:57.361843927 +0000 UTC m=+465.536329946" watchObservedRunningTime="2026-08-04 11:40:57.362484263 +0000 UTC m=+465.536970273"
Aug 04 11:40:59.357857 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:59.357821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2" event={"ID":"7fee3bb2-8e48-42d3-9164-aa6151d18b76","Type":"ContainerStarted","Data":"11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a"}
Aug 04 11:40:59.358289 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:59.357950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:40:59.374207 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:40:59.374160    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2" podStartSLOduration=0.970624029 podStartE2EDuration="3.374147746s" totalImagesPullingTime="2.403523717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:59.372767104 +0000 UTC m=+467.547253106" watchObservedRunningTime="2026-08-04 11:40:59.374147746 +0000 UTC m=+467.548633748"
Aug 04 11:41:02.312952 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:02.312924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-75z7t"
Aug 04 11:41:07.348707 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:07.348677    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:08.353693 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:08.353662    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5s7v4"
Aug 04 11:41:09.078422 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.078376    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"]
Aug 04 11:41:09.078681 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.078558    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" containerName="manager" containerID="cri-o://e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259" gracePeriod=2
Aug 04 11:41:09.097653 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.097630    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"]
Aug 04 11:41:09.105674 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.105642    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3af5e807-6899-424d-b250-6efec8fb8db5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-czbcn\": pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.113930 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.113903    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"]
Aug 04 11:41:09.114150 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.114126    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" containerName="manager" containerID="cri-o://11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a" gracePeriod=2
Aug 04 11:41:09.116653 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.116597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.118827 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.118799    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.127101 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.127078    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"]
Aug 04 11:41:09.127631 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.127610    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" containerName="manager"
Aug 04 11:41:09.127710 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.127636    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" containerName="manager"
Aug 04 11:41:09.127748 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.127730    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" containerName="manager"
Aug 04 11:41:09.131025 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.131007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.139983 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.139958    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"]
Aug 04 11:41:09.149983 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.149960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"]
Aug 04 11:41:09.151215 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.151184    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7fee3bb2-8e48-42d3-9164-aa6151d18b76\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-dj4d2\": pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.153220 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.153191    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.154250 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.154230    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"]
Aug 04 11:41:09.154568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.154556    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" containerName="manager"
Aug 04 11:41:09.154616 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.154570    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" containerName="manager"
Aug 04 11:41:09.154663 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.154651    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" containerName="manager"
Aug 04 11:41:09.154747 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.154723    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.157590 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.157565    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:09.178474 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.178441    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"]
Aug 04 11:41:09.180445 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.180392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5gm\" (UniqueName: \"kubernetes.io/projected/607102d2-e97a-4315-be2f-13a41aafe5fa-kube-api-access-xw5gm\") pod \"limitador-operator-controller-manager-6c549b6d85-f62nh\" (UID: \"607102d2-e97a-4315-be2f-13a41aafe5fa\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:09.180556 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.180528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5p9s\" (UniqueName: \"kubernetes.io/projected/fe3378d8-1099-49db-88c9-13a4ebe1eda2-kube-api-access-t5p9s\") pod \"kuadrant-operator-controller-manager-58fc56757c-n56p4\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.180556 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.180552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe3378d8-1099-49db-88c9-13a4ebe1eda2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n56p4\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.214696 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.214650    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.220451 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.217910    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.281849 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.281810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5gm\" (UniqueName: \"kubernetes.io/projected/607102d2-e97a-4315-be2f-13a41aafe5fa-kube-api-access-xw5gm\") pod \"limitador-operator-controller-manager-6c549b6d85-f62nh\" (UID: \"607102d2-e97a-4315-be2f-13a41aafe5fa\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:09.282042 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.281907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5p9s\" (UniqueName: \"kubernetes.io/projected/fe3378d8-1099-49db-88c9-13a4ebe1eda2-kube-api-access-t5p9s\") pod \"kuadrant-operator-controller-manager-58fc56757c-n56p4\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.282042 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.281928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe3378d8-1099-49db-88c9-13a4ebe1eda2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n56p4\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.282288 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.282267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe3378d8-1099-49db-88c9-13a4ebe1eda2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n56p4\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.297035 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.296978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5gm\" (UniqueName: \"kubernetes.io/projected/607102d2-e97a-4315-be2f-13a41aafe5fa-kube-api-access-xw5gm\") pod \"limitador-operator-controller-manager-6c549b6d85-f62nh\" (UID: \"607102d2-e97a-4315-be2f-13a41aafe5fa\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:09.297726 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.297689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5p9s\" (UniqueName: \"kubernetes.io/projected/fe3378d8-1099-49db-88c9-13a4ebe1eda2-kube-api-access-t5p9s\") pod \"kuadrant-operator-controller-manager-58fc56757c-n56p4\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.357243 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.357219    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.359285 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.359259    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.359608 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.359591    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.360930 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.360909    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.362543 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.362521    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.364009 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.363990    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.382989 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.382965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3af5e807-6899-424d-b250-6efec8fb8db5-extensions-socket-volume\") pod \"3af5e807-6899-424d-b250-6efec8fb8db5\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") "
Aug 04 11:41:09.383088 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.383009    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsx8m\" (UniqueName: \"kubernetes.io/projected/3af5e807-6899-424d-b250-6efec8fb8db5-kube-api-access-vsx8m\") pod \"3af5e807-6899-424d-b250-6efec8fb8db5\" (UID: \"3af5e807-6899-424d-b250-6efec8fb8db5\") "
Aug 04 11:41:09.383088 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.383074    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6qdb\" (UniqueName: \"kubernetes.io/projected/7fee3bb2-8e48-42d3-9164-aa6151d18b76-kube-api-access-b6qdb\") pod \"7fee3bb2-8e48-42d3-9164-aa6151d18b76\" (UID: \"7fee3bb2-8e48-42d3-9164-aa6151d18b76\") "
Aug 04 11:41:09.383429 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.383379    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af5e807-6899-424d-b250-6efec8fb8db5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3af5e807-6899-424d-b250-6efec8fb8db5" (UID: "3af5e807-6899-424d-b250-6efec8fb8db5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:41:09.385236 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.385210    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fee3bb2-8e48-42d3-9164-aa6151d18b76-kube-api-access-b6qdb" (OuterVolumeSpecName: "kube-api-access-b6qdb") pod "7fee3bb2-8e48-42d3-9164-aa6151d18b76" (UID: "7fee3bb2-8e48-42d3-9164-aa6151d18b76"). InnerVolumeSpecName "kube-api-access-b6qdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:41:09.385322 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.385250    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af5e807-6899-424d-b250-6efec8fb8db5-kube-api-access-vsx8m" (OuterVolumeSpecName: "kube-api-access-vsx8m") pod "3af5e807-6899-424d-b250-6efec8fb8db5" (UID: "3af5e807-6899-424d-b250-6efec8fb8db5"). InnerVolumeSpecName "kube-api-access-vsx8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:41:09.408933 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.408900    2582 generic.go:356] "Generic (PLEG): container finished" podID="3af5e807-6899-424d-b250-6efec8fb8db5" containerID="e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259" exitCode=0
Aug 04 11:41:09.409022 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.408936    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.409022 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.409008    2582 scope.go:117] "RemoveContainer" containerID="e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259"
Aug 04 11:41:09.410329 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.410306    2582 generic.go:356] "Generic (PLEG): container finished" podID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" containerID="11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a" exitCode=0
Aug 04 11:41:09.410439 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.410338    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.411217 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.411193    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.412878 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.412852    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.414513 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.414493    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.416066 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.416041    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.418917 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.418826    2582 scope.go:117] "RemoveContainer" containerID="e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259"
Aug 04 11:41:09.419165 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.419135    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259\": container with ID starting with e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259 not found: ID does not exist" containerID="e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259"
Aug 04 11:41:09.419261 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.419170    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259"} err="failed to get container status \"e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259\": rpc error: code = NotFound desc = could not find container \"e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259\": container with ID starting with e95071872424c250b53b9d5967bf69c071a6c0f42a309770350a299daff89259 not found: ID does not exist"
Aug 04 11:41:09.419261 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.419193    2582 scope.go:117] "RemoveContainer" containerID="11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a"
Aug 04 11:41:09.423979 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.423951    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.425510 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.425489    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.427062 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.427043    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-czbcn\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-czbcn"
Aug 04 11:41:09.427739 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.427722    2582 scope.go:117] "RemoveContainer" containerID="11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a"
Aug 04 11:41:09.427991 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.427976    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a\": container with ID starting with 11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a not found: ID does not exist" containerID="11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a"
Aug 04 11:41:09.428030 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.427996    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a"} err="failed to get container status \"11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a\": rpc error: code = NotFound desc = could not find container \"11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a\": container with ID starting with 11d5cce6d8b293f951816f55d45df1e889eba56af5273184957328b07b6e933a not found: ID does not exist"
Aug 04 11:41:09.428437 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:09.428420    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-dj4d2\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-dj4d2"
Aug 04 11:41:09.484047 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.484006    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6qdb\" (UniqueName: \"kubernetes.io/projected/7fee3bb2-8e48-42d3-9164-aa6151d18b76-kube-api-access-b6qdb\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:41:09.484047 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.484034    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3af5e807-6899-424d-b250-6efec8fb8db5-extensions-socket-volume\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:41:09.484047 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.484045    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsx8m\" (UniqueName: \"kubernetes.io/projected/3af5e807-6899-424d-b250-6efec8fb8db5-kube-api-access-vsx8m\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:41:09.509743 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.509719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:09.515852 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.515828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:09.652948 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.652923    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"]
Aug 04 11:41:09.655685 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:41:09.655656    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3378d8_1099_49db_88c9_13a4ebe1eda2.slice/crio-66190329c5fa89d93c1ae520cde5270ae225dad61d69ab785b69ab5b99eedf96 WatchSource:0}: Error finding container 66190329c5fa89d93c1ae520cde5270ae225dad61d69ab785b69ab5b99eedf96: Status 404 returned error can't find the container with id 66190329c5fa89d93c1ae520cde5270ae225dad61d69ab785b69ab5b99eedf96
Aug 04 11:41:09.676347 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:09.676321    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"]
Aug 04 11:41:09.677911 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:41:09.677889    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607102d2_e97a_4315_be2f_13a41aafe5fa.slice/crio-025b10206d2d85095893287d89eca4d3f9cb041f029968310f685a2bfe1eed1b WatchSource:0}: Error finding container 025b10206d2d85095893287d89eca4d3f9cb041f029968310f685a2bfe1eed1b: Status 404 returned error can't find the container with id 025b10206d2d85095893287d89eca4d3f9cb041f029968310f685a2bfe1eed1b
Aug 04 11:41:10.349515 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.349443    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af5e807-6899-424d-b250-6efec8fb8db5" path="/var/lib/kubelet/pods/3af5e807-6899-424d-b250-6efec8fb8db5/volumes"
Aug 04 11:41:10.349757 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.349745    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fee3bb2-8e48-42d3-9164-aa6151d18b76" path="/var/lib/kubelet/pods/7fee3bb2-8e48-42d3-9164-aa6151d18b76/volumes"
Aug 04 11:41:10.418166 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.418127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh" event={"ID":"607102d2-e97a-4315-be2f-13a41aafe5fa","Type":"ContainerStarted","Data":"965d67ee6ed9b5be889e48195abd4e973f099ae29ea8ac216919b686bbd67515"}
Aug 04 11:41:10.418598 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.418185    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:10.418598 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.418210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh" event={"ID":"607102d2-e97a-4315-be2f-13a41aafe5fa","Type":"ContainerStarted","Data":"025b10206d2d85095893287d89eca4d3f9cb041f029968310f685a2bfe1eed1b"}
Aug 04 11:41:10.422215 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.422187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4" event={"ID":"fe3378d8-1099-49db-88c9-13a4ebe1eda2","Type":"ContainerStarted","Data":"c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708"}
Aug 04 11:41:10.422356 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.422234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4" event={"ID":"fe3378d8-1099-49db-88c9-13a4ebe1eda2","Type":"ContainerStarted","Data":"66190329c5fa89d93c1ae520cde5270ae225dad61d69ab785b69ab5b99eedf96"}
Aug 04 11:41:10.422356 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.422283    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:10.478225 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.478171    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh" podStartSLOduration=1.4781557969999999 podStartE2EDuration="1.478155797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:41:10.476163412 +0000 UTC m=+478.650649416" watchObservedRunningTime="2026-08-04 11:41:10.478155797 +0000 UTC m=+478.652641799"
Aug 04 11:41:10.511002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:10.510951    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4" podStartSLOduration=1.5109359580000001 podStartE2EDuration="1.510935958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:41:10.510492402 +0000 UTC m=+478.684978404" watchObservedRunningTime="2026-08-04 11:41:10.510935958 +0000 UTC m=+478.685421961"
Aug 04 11:41:12.221707 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:12.221675    2582 scope.go:117] "RemoveContainer" containerID="8c88057cffd6b521a7608acb525c540e5c0047fa28e4aaca0eef380e8646820e"
Aug 04 11:41:21.429682 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:21.429649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:21.430122 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:21.429818    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f62nh"
Aug 04 11:41:26.203895 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:26.203865    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"]
Aug 04 11:41:26.204290 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:26.204081    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4" podUID="fe3378d8-1099-49db-88c9-13a4ebe1eda2" containerName="manager" containerID="cri-o://c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708" gracePeriod=10
Aug 04 11:41:26.950142 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:26.950117    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:27.027160 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.027084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe3378d8-1099-49db-88c9-13a4ebe1eda2-extensions-socket-volume\") pod \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") "
Aug 04 11:41:27.027160 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.027137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5p9s\" (UniqueName: \"kubernetes.io/projected/fe3378d8-1099-49db-88c9-13a4ebe1eda2-kube-api-access-t5p9s\") pod \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\" (UID: \"fe3378d8-1099-49db-88c9-13a4ebe1eda2\") "
Aug 04 11:41:27.027460 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.027437    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe3378d8-1099-49db-88c9-13a4ebe1eda2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe3378d8-1099-49db-88c9-13a4ebe1eda2" (UID: "fe3378d8-1099-49db-88c9-13a4ebe1eda2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:41:27.029128 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.029107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3378d8-1099-49db-88c9-13a4ebe1eda2-kube-api-access-t5p9s" (OuterVolumeSpecName: "kube-api-access-t5p9s") pod "fe3378d8-1099-49db-88c9-13a4ebe1eda2" (UID: "fe3378d8-1099-49db-88c9-13a4ebe1eda2"). InnerVolumeSpecName "kube-api-access-t5p9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:41:27.127816 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.127788    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5p9s\" (UniqueName: \"kubernetes.io/projected/fe3378d8-1099-49db-88c9-13a4ebe1eda2-kube-api-access-t5p9s\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:41:27.127816 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.127813    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe3378d8-1099-49db-88c9-13a4ebe1eda2-extensions-socket-volume\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:41:27.508311 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.508277    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe3378d8-1099-49db-88c9-13a4ebe1eda2" containerID="c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708" exitCode=0
Aug 04 11:41:27.508777 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.508329    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"
Aug 04 11:41:27.508777 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.508368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4" event={"ID":"fe3378d8-1099-49db-88c9-13a4ebe1eda2","Type":"ContainerDied","Data":"c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708"}
Aug 04 11:41:27.508777 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.508464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4" event={"ID":"fe3378d8-1099-49db-88c9-13a4ebe1eda2","Type":"ContainerDied","Data":"66190329c5fa89d93c1ae520cde5270ae225dad61d69ab785b69ab5b99eedf96"}
Aug 04 11:41:27.508777 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.508502    2582 scope.go:117] "RemoveContainer" containerID="c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708"
Aug 04 11:41:27.517196 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.517178    2582 scope.go:117] "RemoveContainer" containerID="c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708"
Aug 04 11:41:27.517460 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:41:27.517444    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708\": container with ID starting with c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708 not found: ID does not exist" containerID="c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708"
Aug 04 11:41:27.517506 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.517470    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708"} err="failed to get container status \"c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708\": rpc error: code = NotFound desc = could not find container \"c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708\": container with ID starting with c58c411ecb60bb8a2f244b71766f7fb749e2e3a7954379d1e7bdfd642d0ec708 not found: ID does not exist"
Aug 04 11:41:27.530321 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.530301    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"]
Aug 04 11:41:27.536038 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:27.536016    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n56p4"]
Aug 04 11:41:28.349818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:28.349785    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3378d8-1099-49db-88c9-13a4ebe1eda2" path="/var/lib/kubelet/pods/fe3378d8-1099-49db-88c9-13a4ebe1eda2/volumes"
Aug 04 11:41:42.472115 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.472082    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"]
Aug 04 11:41:42.472673 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.472603    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3378d8-1099-49db-88c9-13a4ebe1eda2" containerName="manager"
Aug 04 11:41:42.472673 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.472624    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3378d8-1099-49db-88c9-13a4ebe1eda2" containerName="manager"
Aug 04 11:41:42.472791 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.472730    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3378d8-1099-49db-88c9-13a4ebe1eda2" containerName="manager"
Aug 04 11:41:42.475646 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.475624    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.477568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.477544    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tp6nj\""
Aug 04 11:41:42.487683 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.487660    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"]
Aug 04 11:41:42.560202 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560360 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560360 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560360 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg4s7\" (UniqueName: \"kubernetes.io/projected/a49badea-3e9e-4d50-9ba6-2767ec34a04b-kube-api-access-vg4s7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560481 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560481 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.560568 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.560559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.661808 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.661777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg4s7\" (UniqueName: \"kubernetes.io/projected/a49badea-3e9e-4d50-9ba6-2767ec34a04b-kube-api-access-vg4s7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.661808 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.661809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662020 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.661836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662020 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.661956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662020 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662141    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662335 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662335 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662448 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662508 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662551 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.662738 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.662720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.664299 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.664279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.664515 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.664500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.669818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.669798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg4s7\" (UniqueName: \"kubernetes.io/projected/a49badea-3e9e-4d50-9ba6-2767ec34a04b-kube-api-access-vg4s7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.669944 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.669926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a49badea-3e9e-4d50-9ba6-2767ec34a04b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p6zbq\" (UID: \"a49badea-3e9e-4d50-9ba6-2767ec34a04b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.786058 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.785988    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:42.919375 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.919348    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"]
Aug 04 11:41:42.921163 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:41:42.921135    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49badea_3e9e_4d50_9ba6_2767ec34a04b.slice/crio-08e1d791915e856dce3fb3c00f9ef1b12ffba00ba47af9a7d1bc663d88726c29 WatchSource:0}: Error finding container 08e1d791915e856dce3fb3c00f9ef1b12ffba00ba47af9a7d1bc663d88726c29: Status 404 returned error can't find the container with id 08e1d791915e856dce3fb3c00f9ef1b12ffba00ba47af9a7d1bc663d88726c29
Aug 04 11:41:42.923203 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.923167    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:41:42.923273 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.923232    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:41:42.923273 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:42.923259    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:41:43.588780 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:43.588746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" event={"ID":"a49badea-3e9e-4d50-9ba6-2767ec34a04b","Type":"ContainerStarted","Data":"d61d49d1eb1a3a64a08761a378955c4cea9485890a68dc8477461249d15dea85"}
Aug 04 11:41:43.589213 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:43.588797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" event={"ID":"a49badea-3e9e-4d50-9ba6-2767ec34a04b","Type":"ContainerStarted","Data":"08e1d791915e856dce3fb3c00f9ef1b12ffba00ba47af9a7d1bc663d88726c29"}
Aug 04 11:41:43.608419 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:43.608358    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" podStartSLOduration=1.6083438289999998 podStartE2EDuration="1.608343829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:41:43.606799119 +0000 UTC m=+511.781285119" watchObservedRunningTime="2026-08-04 11:41:43.608343829 +0000 UTC m=+511.782829896"
Aug 04 11:41:43.787048 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:43.787013    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:43.792085 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:43.792058    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:44.594245 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:44.594207    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:44.595212 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:44.595191    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:41:47.303864 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.303833    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:41:47.307254 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.307237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.309354 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.309334    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 11:41:47.309451 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.309377    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfnjq\""
Aug 04 11:41:47.314937 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.314911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:41:47.396775 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.396738    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:41:47.402012 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.401985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d1c200f-a18e-49d6-831b-48ce54c688ce-config-file\") pod \"limitador-limitador-859c4d96d6-gffcp\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.402109 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.402048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsvst\" (UniqueName: \"kubernetes.io/projected/5d1c200f-a18e-49d6-831b-48ce54c688ce-kube-api-access-vsvst\") pod \"limitador-limitador-859c4d96d6-gffcp\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.503307 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.503267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsvst\" (UniqueName: \"kubernetes.io/projected/5d1c200f-a18e-49d6-831b-48ce54c688ce-kube-api-access-vsvst\") pod \"limitador-limitador-859c4d96d6-gffcp\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.503494 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.503384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d1c200f-a18e-49d6-831b-48ce54c688ce-config-file\") pod \"limitador-limitador-859c4d96d6-gffcp\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.504556 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.504529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d1c200f-a18e-49d6-831b-48ce54c688ce-config-file\") pod \"limitador-limitador-859c4d96d6-gffcp\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.512201 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.512172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsvst\" (UniqueName: \"kubernetes.io/projected/5d1c200f-a18e-49d6-831b-48ce54c688ce-kube-api-access-vsvst\") pod \"limitador-limitador-859c4d96d6-gffcp\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.618919 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.618890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:47.691198 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.691152    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:41:47.696338 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.696316    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:47.703592 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.703529    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:41:47.735788 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.735731    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:41:47.755550 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.755520    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:41:47.756585 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:41:47.756561    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1c200f_a18e_49d6_831b_48ce54c688ce.slice/crio-f1d9b32b4ea174f035af6669a1e09b75e56e964f5daaed0884f438b22a470181 WatchSource:0}: Error finding container f1d9b32b4ea174f035af6669a1e09b75e56e964f5daaed0884f438b22a470181: Status 404 returned error can't find the container with id f1d9b32b4ea174f035af6669a1e09b75e56e964f5daaed0884f438b22a470181
Aug 04 11:41:47.805946 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.805902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/763124e4-5883-4d53-b0b9-e1b3dc03ee26-config-file\") pod \"limitador-limitador-85d9db4d5d-2rccr\" (UID: \"763124e4-5883-4d53-b0b9-e1b3dc03ee26\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:47.806115 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.805964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbr6\" (UniqueName: \"kubernetes.io/projected/763124e4-5883-4d53-b0b9-e1b3dc03ee26-kube-api-access-hqbr6\") pod \"limitador-limitador-85d9db4d5d-2rccr\" (UID: \"763124e4-5883-4d53-b0b9-e1b3dc03ee26\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:47.907150 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.907069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/763124e4-5883-4d53-b0b9-e1b3dc03ee26-config-file\") pod \"limitador-limitador-85d9db4d5d-2rccr\" (UID: \"763124e4-5883-4d53-b0b9-e1b3dc03ee26\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:47.907150 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.907116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbr6\" (UniqueName: \"kubernetes.io/projected/763124e4-5883-4d53-b0b9-e1b3dc03ee26-kube-api-access-hqbr6\") pod \"limitador-limitador-85d9db4d5d-2rccr\" (UID: \"763124e4-5883-4d53-b0b9-e1b3dc03ee26\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:47.907770 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.907737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/763124e4-5883-4d53-b0b9-e1b3dc03ee26-config-file\") pod \"limitador-limitador-85d9db4d5d-2rccr\" (UID: \"763124e4-5883-4d53-b0b9-e1b3dc03ee26\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:47.919117 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:47.919094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbr6\" (UniqueName: \"kubernetes.io/projected/763124e4-5883-4d53-b0b9-e1b3dc03ee26-kube-api-access-hqbr6\") pod \"limitador-limitador-85d9db4d5d-2rccr\" (UID: \"763124e4-5883-4d53-b0b9-e1b3dc03ee26\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:48.011224 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:48.011192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:48.137742 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:48.137721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:41:48.139780 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:41:48.139745    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763124e4_5883_4d53_b0b9_e1b3dc03ee26.slice/crio-adbaa3afd679aabb3264cd2d84eabe50672a27bbff39655df659b85b97651065 WatchSource:0}: Error finding container adbaa3afd679aabb3264cd2d84eabe50672a27bbff39655df659b85b97651065: Status 404 returned error can't find the container with id adbaa3afd679aabb3264cd2d84eabe50672a27bbff39655df659b85b97651065
Aug 04 11:41:48.616498 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:48.616461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp" event={"ID":"5d1c200f-a18e-49d6-831b-48ce54c688ce","Type":"ContainerStarted","Data":"f1d9b32b4ea174f035af6669a1e09b75e56e964f5daaed0884f438b22a470181"}
Aug 04 11:41:48.617621 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:48.617598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr" event={"ID":"763124e4-5883-4d53-b0b9-e1b3dc03ee26","Type":"ContainerStarted","Data":"adbaa3afd679aabb3264cd2d84eabe50672a27bbff39655df659b85b97651065"}
Aug 04 11:41:50.629857 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:50.629822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr" event={"ID":"763124e4-5883-4d53-b0b9-e1b3dc03ee26","Type":"ContainerStarted","Data":"e7676502b5c82f5aaaa2920b96b08d969157fb5bdb576f308dda197d7692a393"}
Aug 04 11:41:50.630305 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:50.629887    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:41:50.631297 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:50.631276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp" event={"ID":"5d1c200f-a18e-49d6-831b-48ce54c688ce","Type":"ContainerStarted","Data":"95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d"}
Aug 04 11:41:50.631423 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:50.631321    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:41:50.648253 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:50.648207    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr" podStartSLOduration=1.46569174 podStartE2EDuration="3.648192242s" totalImagesPullingTime="2.182500502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:41:50.645768896 +0000 UTC m=+518.820254896" watchObservedRunningTime="2026-08-04 11:41:50.648192242 +0000 UTC m=+518.822678234"
Aug 04 11:41:50.661621 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:41:50.661579    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp" podStartSLOduration=1.774146636 podStartE2EDuration="3.661564799s" totalImagesPullingTime="1.887418163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:41:50.659925606 +0000 UTC m=+518.834411609" watchObservedRunningTime="2026-08-04 11:41:50.661564799 +0000 UTC m=+518.836050799"
Aug 04 11:42:01.637212 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:01.637178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"
Aug 04 11:42:01.637668 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:01.637341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:42:01.696345 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:01.696315    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:42:01.696518 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:01.696482    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp" podUID="5d1c200f-a18e-49d6-831b-48ce54c688ce" containerName="limitador" containerID="cri-o://95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d" gracePeriod=30
Aug 04 11:42:02.233022 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.232994    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:42:02.334995 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.334908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsvst\" (UniqueName: \"kubernetes.io/projected/5d1c200f-a18e-49d6-831b-48ce54c688ce-kube-api-access-vsvst\") pod \"5d1c200f-a18e-49d6-831b-48ce54c688ce\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") "
Aug 04 11:42:02.334995 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.334973    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d1c200f-a18e-49d6-831b-48ce54c688ce-config-file\") pod \"5d1c200f-a18e-49d6-831b-48ce54c688ce\" (UID: \"5d1c200f-a18e-49d6-831b-48ce54c688ce\") "
Aug 04 11:42:02.335266 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.335244    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1c200f-a18e-49d6-831b-48ce54c688ce-config-file" (OuterVolumeSpecName: "config-file") pod "5d1c200f-a18e-49d6-831b-48ce54c688ce" (UID: "5d1c200f-a18e-49d6-831b-48ce54c688ce"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:42:02.336980 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.336948    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1c200f-a18e-49d6-831b-48ce54c688ce-kube-api-access-vsvst" (OuterVolumeSpecName: "kube-api-access-vsvst") pod "5d1c200f-a18e-49d6-831b-48ce54c688ce" (UID: "5d1c200f-a18e-49d6-831b-48ce54c688ce"). InnerVolumeSpecName "kube-api-access-vsvst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:42:02.436185 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.436152    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsvst\" (UniqueName: \"kubernetes.io/projected/5d1c200f-a18e-49d6-831b-48ce54c688ce-kube-api-access-vsvst\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:42:02.436185 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.436183    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d1c200f-a18e-49d6-831b-48ce54c688ce-config-file\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:42:02.692860 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.692823    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d1c200f-a18e-49d6-831b-48ce54c688ce" containerID="95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d" exitCode=0
Aug 04 11:42:02.693303 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.692884    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp"
Aug 04 11:42:02.693303 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.692888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp" event={"ID":"5d1c200f-a18e-49d6-831b-48ce54c688ce","Type":"ContainerDied","Data":"95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d"}
Aug 04 11:42:02.693303 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.693015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gffcp" event={"ID":"5d1c200f-a18e-49d6-831b-48ce54c688ce","Type":"ContainerDied","Data":"f1d9b32b4ea174f035af6669a1e09b75e56e964f5daaed0884f438b22a470181"}
Aug 04 11:42:02.693303 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.693039    2582 scope.go:117] "RemoveContainer" containerID="95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d"
Aug 04 11:42:02.701687 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.701501    2582 scope.go:117] "RemoveContainer" containerID="95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d"
Aug 04 11:42:02.701766 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:42:02.701748    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d\": container with ID starting with 95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d not found: ID does not exist" containerID="95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d"
Aug 04 11:42:02.701809 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.701773    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d"} err="failed to get container status \"95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d\": rpc error: code = NotFound desc = could not find container \"95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d\": container with ID starting with 95bfb7b1f5cbdefeb375e7ffd3ed9e36e3c9d1b3e499d959ba52044aff5b7a6d not found: ID does not exist"
Aug 04 11:42:02.707859 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.707838    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:42:02.711486 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:02.711466    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gffcp"]
Aug 04 11:42:04.349235 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:04.349162    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1c200f-a18e-49d6-831b-48ce54c688ce" path="/var/lib/kubelet/pods/5d1c200f-a18e-49d6-831b-48ce54c688ce/volumes"
Aug 04 11:42:24.099574 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.099540    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7b8cc66b-ss52l"]
Aug 04 11:42:24.100002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.099881    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1c200f-a18e-49d6-831b-48ce54c688ce" containerName="limitador"
Aug 04 11:42:24.100002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.099893    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1c200f-a18e-49d6-831b-48ce54c688ce" containerName="limitador"
Aug 04 11:42:24.100002 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.099953    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1c200f-a18e-49d6-831b-48ce54c688ce" containerName="limitador"
Aug 04 11:42:24.103467 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.103450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.105926 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.105910    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 11:42:24.106037 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.106006    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w46zc\""
Aug 04 11:42:24.106246 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.106206    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 11:42:24.120835 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.120802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7b8cc66b-ss52l"]
Aug 04 11:42:24.220910 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.220874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04bcabe-4774-4b26-8bc7-057edecc34a1-webhook-cert\") pod \"maas-controller-7f7b8cc66b-ss52l\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") " pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.221080 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.220960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz8rb\" (UniqueName: \"kubernetes.io/projected/f04bcabe-4774-4b26-8bc7-057edecc34a1-kube-api-access-kz8rb\") pod \"maas-controller-7f7b8cc66b-ss52l\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") " pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.322349 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.322316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz8rb\" (UniqueName: \"kubernetes.io/projected/f04bcabe-4774-4b26-8bc7-057edecc34a1-kube-api-access-kz8rb\") pod \"maas-controller-7f7b8cc66b-ss52l\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") " pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.322555 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.322380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04bcabe-4774-4b26-8bc7-057edecc34a1-webhook-cert\") pod \"maas-controller-7f7b8cc66b-ss52l\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") " pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.324742 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.324717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04bcabe-4774-4b26-8bc7-057edecc34a1-webhook-cert\") pod \"maas-controller-7f7b8cc66b-ss52l\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") " pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.332721 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.332700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz8rb\" (UniqueName: \"kubernetes.io/projected/f04bcabe-4774-4b26-8bc7-057edecc34a1-kube-api-access-kz8rb\") pod \"maas-controller-7f7b8cc66b-ss52l\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") " pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.414092 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.413995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:24.545920 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.545891    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7b8cc66b-ss52l"]
Aug 04 11:42:24.547024 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:42:24.547002    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04bcabe_4774_4b26_8bc7_057edecc34a1.slice/crio-407582a2ae4ad18d7b5dd4a3b3362e31180576e0535cf3b56835a8a8d80b5d2b WatchSource:0}: Error finding container 407582a2ae4ad18d7b5dd4a3b3362e31180576e0535cf3b56835a8a8d80b5d2b: Status 404 returned error can't find the container with id 407582a2ae4ad18d7b5dd4a3b3362e31180576e0535cf3b56835a8a8d80b5d2b
Aug 04 11:42:24.802114 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:24.802037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l" event={"ID":"f04bcabe-4774-4b26-8bc7-057edecc34a1","Type":"ContainerStarted","Data":"407582a2ae4ad18d7b5dd4a3b3362e31180576e0535cf3b56835a8a8d80b5d2b"}
Aug 04 11:42:27.818853 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:27.818821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l" event={"ID":"f04bcabe-4774-4b26-8bc7-057edecc34a1","Type":"ContainerStarted","Data":"3395e33729cbb7420974f0351b36222dca2d767ea7007f75e862f8edda92fa63"}
Aug 04 11:42:27.819235 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:27.818933    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:27.839070 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:27.839022    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l" podStartSLOduration=1.544794341 podStartE2EDuration="3.839004589s" totalImagesPullingTime="2.294210248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:42:27.837071396 +0000 UTC m=+556.011557397" watchObservedRunningTime="2026-08-04 11:42:27.839004589 +0000 UTC m=+556.013490592"
Aug 04 11:42:38.648544 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:38.648498    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7b8cc66b-ss52l"]
Aug 04 11:42:38.649091 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:38.648790    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l" podUID="f04bcabe-4774-4b26-8bc7-057edecc34a1" containerName="manager" containerID="cri-o://3395e33729cbb7420974f0351b36222dca2d767ea7007f75e862f8edda92fa63" gracePeriod=30
Aug 04 11:42:38.650715 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:38.650696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:38.874148 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:38.874115    2582 generic.go:356] "Generic (PLEG): container finished" podID="f04bcabe-4774-4b26-8bc7-057edecc34a1" containerID="3395e33729cbb7420974f0351b36222dca2d767ea7007f75e862f8edda92fa63" exitCode=0
Aug 04 11:42:38.874326 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:38.874150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l" event={"ID":"f04bcabe-4774-4b26-8bc7-057edecc34a1","Type":"ContainerDied","Data":"3395e33729cbb7420974f0351b36222dca2d767ea7007f75e862f8edda92fa63"}
Aug 04 11:42:38.901043 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:38.900989    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:39.057538 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.057501    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04bcabe-4774-4b26-8bc7-057edecc34a1-webhook-cert\") pod \"f04bcabe-4774-4b26-8bc7-057edecc34a1\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") "
Aug 04 11:42:39.057704 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.057581    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz8rb\" (UniqueName: \"kubernetes.io/projected/f04bcabe-4774-4b26-8bc7-057edecc34a1-kube-api-access-kz8rb\") pod \"f04bcabe-4774-4b26-8bc7-057edecc34a1\" (UID: \"f04bcabe-4774-4b26-8bc7-057edecc34a1\") "
Aug 04 11:42:39.059686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.059651    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04bcabe-4774-4b26-8bc7-057edecc34a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f04bcabe-4774-4b26-8bc7-057edecc34a1" (UID: "f04bcabe-4774-4b26-8bc7-057edecc34a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:42:39.059686 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.059676    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04bcabe-4774-4b26-8bc7-057edecc34a1-kube-api-access-kz8rb" (OuterVolumeSpecName: "kube-api-access-kz8rb") pod "f04bcabe-4774-4b26-8bc7-057edecc34a1" (UID: "f04bcabe-4774-4b26-8bc7-057edecc34a1"). InnerVolumeSpecName "kube-api-access-kz8rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:42:39.158586 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.158493    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f04bcabe-4774-4b26-8bc7-057edecc34a1-webhook-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:42:39.158586 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.158525    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz8rb\" (UniqueName: \"kubernetes.io/projected/f04bcabe-4774-4b26-8bc7-057edecc34a1-kube-api-access-kz8rb\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:42:39.880654 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.880617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l" event={"ID":"f04bcabe-4774-4b26-8bc7-057edecc34a1","Type":"ContainerDied","Data":"407582a2ae4ad18d7b5dd4a3b3362e31180576e0535cf3b56835a8a8d80b5d2b"}
Aug 04 11:42:39.881103 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.880682    2582 scope.go:117] "RemoveContainer" containerID="3395e33729cbb7420974f0351b36222dca2d767ea7007f75e862f8edda92fa63"
Aug 04 11:42:39.881103 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.880627    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7b8cc66b-ss52l"
Aug 04 11:42:39.901980 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.901953    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7b8cc66b-ss52l"]
Aug 04 11:42:39.907499 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:39.907478    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f7b8cc66b-ss52l"]
Aug 04 11:42:40.349482 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:42:40.349453    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04bcabe-4774-4b26-8bc7-057edecc34a1" path="/var/lib/kubelet/pods/f04bcabe-4774-4b26-8bc7-057edecc34a1/volumes"
Aug 04 11:43:00.979042 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.979003    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"]
Aug 04 11:43:00.979517 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.979393    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04bcabe-4774-4b26-8bc7-057edecc34a1" containerName="manager"
Aug 04 11:43:00.979517 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.979420    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04bcabe-4774-4b26-8bc7-057edecc34a1" containerName="manager"
Aug 04 11:43:00.979517 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.979476    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04bcabe-4774-4b26-8bc7-057edecc34a1" containerName="manager"
Aug 04 11:43:00.984247 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.984226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:00.986167 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.986149    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 11:43:00.996735 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:00.996708    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"]
Aug 04 11:43:01.010484 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.010456    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pg5l2"]
Aug 04 11:43:01.012849 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.012831    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.014809 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.014791    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ck2f6\""
Aug 04 11:43:01.024367 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.024343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pg5l2"]
Aug 04 11:43:01.031792 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.031769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f76cab2-dd3b-4819-9346-df1e24436e07-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pg5l2\" (UID: \"0f76cab2-dd3b-4819-9346-df1e24436e07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.031894 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.031821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzvm\" (UniqueName: \"kubernetes.io/projected/0f76cab2-dd3b-4819-9346-df1e24436e07-kube-api-access-jlzvm\") pod \"payload-processing-5cc6cd444b-pg5l2\" (UID: \"0f76cab2-dd3b-4819-9346-df1e24436e07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.031959 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.031890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdgzv\" (UniqueName: \"kubernetes.io/projected/f2300f7c-1069-47f7-b3ef-3d84ce71b43f-kube-api-access-rdgzv\") pod \"payload-pre-processing-687dbb6cf6-lfmh8\" (UID: \"f2300f7c-1069-47f7-b3ef-3d84ce71b43f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.032005 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.031958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2300f7c-1069-47f7-b3ef-3d84ce71b43f-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-lfmh8\" (UID: \"f2300f7c-1069-47f7-b3ef-3d84ce71b43f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.132541 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.132508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2300f7c-1069-47f7-b3ef-3d84ce71b43f-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-lfmh8\" (UID: \"f2300f7c-1069-47f7-b3ef-3d84ce71b43f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.132696 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.132581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f76cab2-dd3b-4819-9346-df1e24436e07-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pg5l2\" (UID: \"0f76cab2-dd3b-4819-9346-df1e24436e07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.132696 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.132624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzvm\" (UniqueName: \"kubernetes.io/projected/0f76cab2-dd3b-4819-9346-df1e24436e07-kube-api-access-jlzvm\") pod \"payload-processing-5cc6cd444b-pg5l2\" (UID: \"0f76cab2-dd3b-4819-9346-df1e24436e07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.132787 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.132765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdgzv\" (UniqueName: \"kubernetes.io/projected/f2300f7c-1069-47f7-b3ef-3d84ce71b43f-kube-api-access-rdgzv\") pod \"payload-pre-processing-687dbb6cf6-lfmh8\" (UID: \"f2300f7c-1069-47f7-b3ef-3d84ce71b43f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.133282 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.133262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2300f7c-1069-47f7-b3ef-3d84ce71b43f-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-lfmh8\" (UID: \"f2300f7c-1069-47f7-b3ef-3d84ce71b43f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.133355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.133339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f76cab2-dd3b-4819-9346-df1e24436e07-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pg5l2\" (UID: \"0f76cab2-dd3b-4819-9346-df1e24436e07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.146234 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.146210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzvm\" (UniqueName: \"kubernetes.io/projected/0f76cab2-dd3b-4819-9346-df1e24436e07-kube-api-access-jlzvm\") pod \"payload-processing-5cc6cd444b-pg5l2\" (UID: \"0f76cab2-dd3b-4819-9346-df1e24436e07\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.146370 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.146317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdgzv\" (UniqueName: \"kubernetes.io/projected/f2300f7c-1069-47f7-b3ef-3d84ce71b43f-kube-api-access-rdgzv\") pod \"payload-pre-processing-687dbb6cf6-lfmh8\" (UID: \"f2300f7c-1069-47f7-b3ef-3d84ce71b43f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.165170 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.165139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:43:01.293941 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.293859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:01.323289 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.323254    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:01.442109 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.442076    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"]
Aug 04 11:43:01.444009 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:43:01.443978    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2300f7c_1069_47f7_b3ef_3d84ce71b43f.slice/crio-8ff8acd679a59f57faff6258c401151bf844d0cd2d265a7cfabf74484345a8f6 WatchSource:0}: Error finding container 8ff8acd679a59f57faff6258c401151bf844d0cd2d265a7cfabf74484345a8f6: Status 404 returned error can't find the container with id 8ff8acd679a59f57faff6258c401151bf844d0cd2d265a7cfabf74484345a8f6
Aug 04 11:43:01.469690 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.469599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pg5l2"]
Aug 04 11:43:01.472829 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:43:01.472799    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f76cab2_dd3b_4819_9346_df1e24436e07.slice/crio-70937970cc5aae78699b298733f908f7dc51e6336d8071dc9ce6444319b031ec WatchSource:0}: Error finding container 70937970cc5aae78699b298733f908f7dc51e6336d8071dc9ce6444319b031ec: Status 404 returned error can't find the container with id 70937970cc5aae78699b298733f908f7dc51e6336d8071dc9ce6444319b031ec
Aug 04 11:43:01.993687 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.993607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2" event={"ID":"0f76cab2-dd3b-4819-9346-df1e24436e07","Type":"ContainerStarted","Data":"70937970cc5aae78699b298733f908f7dc51e6336d8071dc9ce6444319b031ec"}
Aug 04 11:43:01.995584 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:01.995552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8" event={"ID":"f2300f7c-1069-47f7-b3ef-3d84ce71b43f","Type":"ContainerStarted","Data":"8ff8acd679a59f57faff6258c401151bf844d0cd2d265a7cfabf74484345a8f6"}
Aug 04 11:43:04.009870 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:04.009832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2" event={"ID":"0f76cab2-dd3b-4819-9346-df1e24436e07","Type":"ContainerStarted","Data":"4cc371f588266afdffdf1c2d5c3c9a86e90b38b3a1dad2760da469585e28f4ab"}
Aug 04 11:43:04.010301 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:04.009937    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:04.011206 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:04.011186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8" event={"ID":"f2300f7c-1069-47f7-b3ef-3d84ce71b43f","Type":"ContainerStarted","Data":"25739b7d22b1a14e63a26a7c73ce6be33646316707e7027a46df824da9d83ff5"}
Aug 04 11:43:04.011313 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:04.011302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:04.023973 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:04.023918    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2" podStartSLOduration=1.972097545 podStartE2EDuration="4.023902684s" totalImagesPullingTime="2.051805139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:43:04.023268096 +0000 UTC m=+592.197754098" watchObservedRunningTime="2026-08-04 11:43:04.023902684 +0000 UTC m=+592.198388687"
Aug 04 11:43:11.050544 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.050510    2582 generic.go:356] "Generic (PLEG): container finished" podID="a49badea-3e9e-4d50-9ba6-2767ec34a04b" containerID="d61d49d1eb1a3a64a08761a378955c4cea9485890a68dc8477461249d15dea85" exitCode=0
Aug 04 11:43:11.050955 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.050573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" event={"ID":"a49badea-3e9e-4d50-9ba6-2767ec34a04b","Type":"ContainerDied","Data":"d61d49d1eb1a3a64a08761a378955c4cea9485890a68dc8477461249d15dea85"}
Aug 04 11:43:11.050997 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.050966    2582 scope.go:117] "RemoveContainer" containerID="d61d49d1eb1a3a64a08761a378955c4cea9485890a68dc8477461249d15dea85"
Aug 04 11:43:11.051991 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.051957    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:43:11.052070 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.052045    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:43:11.052118 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.052101    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 11:43:11.078034 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:11.077989    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8" podStartSLOduration=8.971609313 podStartE2EDuration="11.077974778s" totalImagesPullingTime="2.106365465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:43:04.044511605 +0000 UTC m=+592.218997610" watchObservedRunningTime="2026-08-04 11:43:11.077974778 +0000 UTC m=+599.252460779"
Aug 04 11:43:12.061740 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:12.061701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" event={"ID":"a49badea-3e9e-4d50-9ba6-2767ec34a04b","Type":"ContainerStarted","Data":"d8686fd6808f6f6ebbc61e76f5f250cfa361768f98ff3822351ff707403a1907"}
Aug 04 11:43:12.786360 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:12.786326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:43:12.787374 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:12.787349    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p6zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 04 11:43:12.787468 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:12.787422    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" podUID="a49badea-3e9e-4d50-9ba6-2767ec34a04b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 04 11:43:13.786610 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:13.786568    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p6zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 04 11:43:13.787014 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:13.786630    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" podUID="a49badea-3e9e-4d50-9ba6-2767ec34a04b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 04 11:43:14.594304 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:14.594266    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:43:14.786753 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:14.786708    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p6zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 04 11:43:14.787237 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:14.786785    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" podUID="a49badea-3e9e-4d50-9ba6-2767ec34a04b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 04 11:43:15.017916 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:15.017867    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8" podUID="f2300f7c-1069-47f7-b3ef-3d84ce71b43f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.42:9004: connect: connection refused"
Aug 04 11:43:15.018510 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:15.018481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-pg5l2"
Aug 04 11:43:15.787244 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:15.787208    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p6zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 04 11:43:15.787683 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:15.787264    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" podUID="a49badea-3e9e-4d50-9ba6-2767ec34a04b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 04 11:43:16.786679 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:16.786637    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p6zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 04 11:43:16.786894 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:16.786707    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq" podUID="a49badea-3e9e-4d50-9ba6-2767ec34a04b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 04 11:43:17.790333 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:17.790304    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:43:17.791208 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:17.791190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p6zbq"
Aug 04 11:43:21.002451 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:21.002413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:43:25.017000 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:25.016972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-lfmh8"
Aug 04 11:43:48.004078 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.003996    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"]
Aug 04 11:43:48.008602 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.008582    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.010733 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.010714    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 11:43:48.011280 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.011249    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5k874\""
Aug 04 11:43:48.011280 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.011275    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 04 11:43:48.011561 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.011260    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 11:43:48.024155 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.024129    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"]
Aug 04 11:43:48.089716 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.089682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.089716 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.089730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.089975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.089751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.089975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.089839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.089975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.089911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.089975 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.089938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwbmm\" (UniqueName: \"kubernetes.io/projected/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-kube-api-access-hwbmm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191300 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191530 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191530 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191530 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwbmm\" (UniqueName: \"kubernetes.io/projected/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-kube-api-access-hwbmm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191530 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191748 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191851 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191830    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191916 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.191916 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.191910    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.193590 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.193570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.193829 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.193812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.199761 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.199739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwbmm\" (UniqueName: \"kubernetes.io/projected/a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2-kube-api-access-hwbmm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22plm\" (UID: \"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.319324 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.319238    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:48.458118 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.458093    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"]
Aug 04 11:43:48.460301 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:43:48.460274    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56f5ec7_eb53_41d2_8a04_a6c2aff5d6d2.slice/crio-b6294447be68e8270723878f745579c67c89f0a8d069fd3d1ab379a79643531b WatchSource:0}: Error finding container b6294447be68e8270723878f745579c67c89f0a8d069fd3d1ab379a79643531b: Status 404 returned error can't find the container with id b6294447be68e8270723878f745579c67c89f0a8d069fd3d1ab379a79643531b
Aug 04 11:43:48.461725 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.461708    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 11:43:48.595597 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:48.595517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:43:49.255527 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:49.255480    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm" event={"ID":"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2","Type":"ContainerStarted","Data":"b6294447be68e8270723878f745579c67c89f0a8d069fd3d1ab379a79643531b"}
Aug 04 11:43:50.261993 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:50.261959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm" event={"ID":"a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2","Type":"ContainerStarted","Data":"0bc2eef7fa081e1d6059b37b7147cc51510f499d5cf60a6ae186024d32a28000"}
Aug 04 11:43:50.279131 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:50.279081    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm" podStartSLOduration=2.287854972 podStartE2EDuration="3.279062655s" totalImagesPullingTime="991.207683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:43:50.27674475 +0000 UTC m=+638.451230756" watchObservedRunningTime="2026-08-04 11:43:50.279062655 +0000 UTC m=+638.453548669"
Aug 04 11:43:54.695275 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:54.695246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:43:58.320357 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:58.320324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:58.321210 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:58.320391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:58.332839 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:58.332817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:43:59.317945 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:43:59.317915    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22plm"
Aug 04 11:44:01.391154 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:01.391119    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:44:21.096889 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:21.096853    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:44:27.029903 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.029866    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"]
Aug 04 11:44:27.033565 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.033547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.035391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.035366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 04 11:44:27.042349 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.042320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"]
Aug 04 11:44:27.140776 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.140748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9njh\" (UniqueName: \"kubernetes.io/projected/91467b30-b27d-48fc-be2c-2168c53e8c0b-kube-api-access-b9njh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.140932 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.140808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.140993 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.140940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91467b30-b27d-48fc-be2c-2168c53e8c0b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.140993 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.140984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.141108 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.141078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.141160 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.141110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242189 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242153    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91467b30-b27d-48fc-be2c-2168c53e8c0b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242355 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242910 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9njh\" (UniqueName: \"kubernetes.io/projected/91467b30-b27d-48fc-be2c-2168c53e8c0b-kube-api-access-b9njh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242910 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242637    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242910 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.242910 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.242717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.244696 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.244667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91467b30-b27d-48fc-be2c-2168c53e8c0b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.244822 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.244806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91467b30-b27d-48fc-be2c-2168c53e8c0b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.249528 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.249505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9njh\" (UniqueName: \"kubernetes.io/projected/91467b30-b27d-48fc-be2c-2168c53e8c0b-kube-api-access-b9njh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-j89cd\" (UID: \"91467b30-b27d-48fc-be2c-2168c53e8c0b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.342655 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.342585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:27.477948 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:27.477921    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"]
Aug 04 11:44:27.479484 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:44:27.479450    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91467b30_b27d_48fc_be2c_2168c53e8c0b.slice/crio-f7996701e458f6d4b12a9ec474538b93f9467b1dd44012026c936cffc3312a34 WatchSource:0}: Error finding container f7996701e458f6d4b12a9ec474538b93f9467b1dd44012026c936cffc3312a34: Status 404 returned error can't find the container with id f7996701e458f6d4b12a9ec474538b93f9467b1dd44012026c936cffc3312a34
Aug 04 11:44:28.456061 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:28.456023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd" event={"ID":"91467b30-b27d-48fc-be2c-2168c53e8c0b","Type":"ContainerStarted","Data":"30faeba055ca4a0824326b88845a7e83f15add39128e2aaa8d26c361f270d638"}
Aug 04 11:44:28.456061 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:28.456065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd" event={"ID":"91467b30-b27d-48fc-be2c-2168c53e8c0b","Type":"ContainerStarted","Data":"f7996701e458f6d4b12a9ec474538b93f9467b1dd44012026c936cffc3312a34"}
Aug 04 11:44:28.471676 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:28.471620    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd" podStartSLOduration=1.313161073 podStartE2EDuration="1.47156628s" totalImagesPullingTime="158.405207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:44:28.471544693 +0000 UTC m=+676.646030696" watchObservedRunningTime="2026-08-04 11:44:28.47156628 +0000 UTC m=+676.646052283"
Aug 04 11:44:28.800690 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:28.800605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:44:37.342928 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:37.342895    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:37.343304 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:37.342944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:37.355347 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:37.355324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:44:37.512168 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:44:37.512141    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-j89cd"
Aug 04 11:46:20.794818 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:46:20.794782    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:46:29.584961 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:46:29.584922    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:46:40.601541 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:46:40.601467    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:48:19.503458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:48:19.503422    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:48:29.594069 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:48:29.594033    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:49:27.594692 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:49:27.594654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:49:34.492336 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:49:34.492257    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:49:49.795878 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:49:49.795843    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:49:55.501863 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:49:55.501830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:50:05.188835 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:50:05.188802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:50:11.805191 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:50:11.805152    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:50:25.599535 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:50:25.599499    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:50:30.998008 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:50:30.997975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:50:36.102979 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:50:36.102940    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:50:57.092833 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:50:57.092794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:51:10.507466 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:51:10.507384    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:51:33.442266 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:51:33.442228    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:51:43.899444 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:51:43.899385    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:51:50.497095 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:51:50.497056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:51:58.291782 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:51:58.291751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:09.298759 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:09.298723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:16.003344 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:16.003303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:22.287819 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:22.287786    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:28.297391 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:28.297357    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:35.704063 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:35.703980    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:44.592491 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:44.592454    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:52.200709 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:52.200676    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:52:57.085279 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:52:57.085245    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:53:01.799614 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:53:01.799581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:53:09.597696 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:53:09.597648    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:53:14.505879 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:53:14.505846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:53:19.591753 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:53:19.591639    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:53:30.188527 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:53:30.188488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:55:46.289798 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:55:46.289718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:55:51.500423 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:55:51.500382    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:56:18.199550 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:56:18.199516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:56:37.701235 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:56:37.701201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:56:44.802275 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:56:44.802237    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:56:52.992173 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:56:52.992139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:56:57.888667 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:56:57.888631    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:08.298157 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:08.298073    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:14.395151 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:14.395116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:23.616954 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:23.616918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:28.445831 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:28.445790    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:38.691311 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:38.691271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:45.197884 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:45.197843    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:57:54.595724 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:57:54.595690    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:58:20.596159 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:20.596126    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:58:25.688773 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:25.688737    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:58:36.392217 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:36.392143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:58:55.788312 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.788280    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"]
Aug 04 11:58:55.792123 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.792103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.794286 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.794261    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d25909fe-kserve-self-signed-certs\""
Aug 04 11:58:55.801819 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.801795    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"]
Aug 04 11:58:55.869189 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.869153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-home\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.869352 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.869214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4c7w\" (UniqueName: \"kubernetes.io/projected/d0fc115b-058d-4045-95f6-6af274f476ce-kube-api-access-p4c7w\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.869352 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.869240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-dshm\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.869352 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.869257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fc115b-058d-4045-95f6-6af274f476ce-tls-certs\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.869352 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.869277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-tmp-dir\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.869352 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.869324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-model-cache\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970220 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-model-cache\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970440 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-home\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970440 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4c7w\" (UniqueName: \"kubernetes.io/projected/d0fc115b-058d-4045-95f6-6af274f476ce-kube-api-access-p4c7w\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970440 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-dshm\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970440 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fc115b-058d-4045-95f6-6af274f476ce-tls-certs\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970440 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-tmp-dir\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970782 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-model-cache\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970848 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-home\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.970848 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.970827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-tmp-dir\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.972559 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.972539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-dshm\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.972713 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.972698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fc115b-058d-4045-95f6-6af274f476ce-tls-certs\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:55.978535 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:55.978517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4c7w\" (UniqueName: \"kubernetes.io/projected/d0fc115b-058d-4045-95f6-6af274f476ce-kube-api-access-p4c7w\") pod \"e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") " pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:56.103330 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:56.103296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:58:56.234657 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:56.234635    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"]
Aug 04 11:58:56.236805 ip-10-0-129-1 kubenswrapper[2582]: W0804 11:58:56.236776    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0fc115b_058d_4045_95f6_6af274f476ce.slice/crio-88d69e63d93b93e3d40336e79affa9da7f3f06eb70bf106acbb8f622dff379d5 WatchSource:0}: Error finding container 88d69e63d93b93e3d40336e79affa9da7f3f06eb70bf106acbb8f622dff379d5: Status 404 returned error can't find the container with id 88d69e63d93b93e3d40336e79affa9da7f3f06eb70bf106acbb8f622dff379d5
Aug 04 11:58:56.939145 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:56.939111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9" event={"ID":"d0fc115b-058d-4045-95f6-6af274f476ce","Type":"ContainerStarted","Data":"06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4"}
Aug 04 11:58:56.939145 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:56.939148    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9" event={"ID":"d0fc115b-058d-4045-95f6-6af274f476ce","Type":"ContainerStarted","Data":"88d69e63d93b93e3d40336e79affa9da7f3f06eb70bf106acbb8f622dff379d5"}
Aug 04 11:58:56.956779 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:56.956730    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9" podStartSLOduration=1.956715572 podStartE2EDuration="1.956715572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:58:56.95507428 +0000 UTC m=+1545.129560282" watchObservedRunningTime="2026-08-04 11:58:56.956715572 +0000 UTC m=+1545.131201613"
Aug 04 11:58:58.296504 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:58:58.296470    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:59:06.104222 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:06.104177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:59:06.104222 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:06.104232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:59:06.116572 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:06.116546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:59:07.003754 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:07.003727    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:59:33.242670 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:33.242638    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"]
Aug 04 11:59:33.494477 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:33.494390    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:59:45.188183 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:45.188150    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:59:48.261343 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.261299    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9" podUID="d0fc115b-058d-4045-95f6-6af274f476ce" containerName="main" containerID="cri-o://06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4" gracePeriod=45
Aug 04 11:59:48.519183 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.519126    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:59:48.649639 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-dshm\") pod \"d0fc115b-058d-4045-95f6-6af274f476ce\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") "
Aug 04 11:59:48.649837 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-tmp-dir\") pod \"d0fc115b-058d-4045-95f6-6af274f476ce\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") "
Aug 04 11:59:48.649837 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649728    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-model-cache\") pod \"d0fc115b-058d-4045-95f6-6af274f476ce\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") "
Aug 04 11:59:48.649837 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4c7w\" (UniqueName: \"kubernetes.io/projected/d0fc115b-058d-4045-95f6-6af274f476ce-kube-api-access-p4c7w\") pod \"d0fc115b-058d-4045-95f6-6af274f476ce\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") "
Aug 04 11:59:48.649997 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649857    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fc115b-058d-4045-95f6-6af274f476ce-tls-certs\") pod \"d0fc115b-058d-4045-95f6-6af274f476ce\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") "
Aug 04 11:59:48.649997 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649885    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-home\") pod \"d0fc115b-058d-4045-95f6-6af274f476ce\" (UID: \"d0fc115b-058d-4045-95f6-6af274f476ce\") "
Aug 04 11:59:48.649997 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649909    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0fc115b-058d-4045-95f6-6af274f476ce" (UID: "d0fc115b-058d-4045-95f6-6af274f476ce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:59:48.649997 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.649979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0fc115b-058d-4045-95f6-6af274f476ce" (UID: "d0fc115b-058d-4045-95f6-6af274f476ce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:59:48.650229 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.650210    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-home" (OuterVolumeSpecName: "home") pod "d0fc115b-058d-4045-95f6-6af274f476ce" (UID: "d0fc115b-058d-4045-95f6-6af274f476ce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:59:48.650289 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.650271    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-model-cache\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:59:48.650348 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.650295    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-tmp-dir\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:59:48.651897 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.651873    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-dshm" (OuterVolumeSpecName: "dshm") pod "d0fc115b-058d-4045-95f6-6af274f476ce" (UID: "d0fc115b-058d-4045-95f6-6af274f476ce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:59:48.652005 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.651920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fc115b-058d-4045-95f6-6af274f476ce-kube-api-access-p4c7w" (OuterVolumeSpecName: "kube-api-access-p4c7w") pod "d0fc115b-058d-4045-95f6-6af274f476ce" (UID: "d0fc115b-058d-4045-95f6-6af274f476ce"). InnerVolumeSpecName "kube-api-access-p4c7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:59:48.652005 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.651977    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fc115b-058d-4045-95f6-6af274f476ce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0fc115b-058d-4045-95f6-6af274f476ce" (UID: "d0fc115b-058d-4045-95f6-6af274f476ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:59:48.751211 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.751183    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4c7w\" (UniqueName: \"kubernetes.io/projected/d0fc115b-058d-4045-95f6-6af274f476ce-kube-api-access-p4c7w\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:59:48.751211 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.751208    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fc115b-058d-4045-95f6-6af274f476ce-tls-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:59:48.751379 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.751217    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-home\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:59:48.751379 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:48.751226    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fc115b-058d-4045-95f6-6af274f476ce-dshm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 11:59:49.209197 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.209163    2582 generic.go:356] "Generic (PLEG): container finished" podID="d0fc115b-058d-4045-95f6-6af274f476ce" containerID="06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4" exitCode=0
Aug 04 11:59:49.209377 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.209204    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"
Aug 04 11:59:49.209377 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.209230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9" event={"ID":"d0fc115b-058d-4045-95f6-6af274f476ce","Type":"ContainerDied","Data":"06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4"}
Aug 04 11:59:49.209377 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.209260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9" event={"ID":"d0fc115b-058d-4045-95f6-6af274f476ce","Type":"ContainerDied","Data":"88d69e63d93b93e3d40336e79affa9da7f3f06eb70bf106acbb8f622dff379d5"}
Aug 04 11:59:49.209377 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.209277    2582 scope.go:117] "RemoveContainer" containerID="06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4"
Aug 04 11:59:49.218623 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.218606    2582 scope.go:117] "RemoveContainer" containerID="06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4"
Aug 04 11:59:49.218875 ip-10-0-129-1 kubenswrapper[2582]: E0804 11:59:49.218858    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4\": container with ID starting with 06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4 not found: ID does not exist" containerID="06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4"
Aug 04 11:59:49.218922 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.218884    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4"} err="failed to get container status \"06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4\": rpc error: code = NotFound desc = could not find container \"06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4\": container with ID starting with 06fd7d169a5f2e2467a0318845f77a1fd4ff357cd272ae491a3748a0130991f4 not found: ID does not exist"
Aug 04 11:59:49.229458 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.229432    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"]
Aug 04 11:59:49.232805 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.232785    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d25909fe-kserve-6c47c7f9f-bk9n9"]
Aug 04 11:59:49.488174 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:49.488093    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 11:59:50.349840 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:50.349805    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0fc115b-058d-4045-95f6-6af274f476ce" path="/var/lib/kubelet/pods/d0fc115b-058d-4045-95f6-6af274f476ce/volumes"
Aug 04 11:59:55.510345 ip-10-0-129-1 kubenswrapper[2582]: I0804 11:59:55.510310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:00:05.693185 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:00:05.693101    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:00:12.900966 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:00:12.900928    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:00:19.600729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:00:19.600691    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:00:28.200279 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:00:28.200245    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:00:39.986348 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:00:39.986310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:00:45.090435 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:00:45.090385    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:03.077692 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:03.077657    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:08.089866 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:08.089828    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:21.195072 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:21.195033    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:26.485999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:26.485961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:33.197314 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:33.197276    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:37.200060 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:37.199974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:47.000111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:47.000080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:01:55.994118 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:01:55.994079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:02:05.699549 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:02:05.699516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:02:23.401982 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:02:23.401950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:02:30.807140 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:02:30.807101    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:02:40.399021 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:02:40.398982    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:02:55.692745 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:02:55.692714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:01.893080 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:01.893039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:07.996506 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:07.996424    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:19.200672 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:19.200640    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:27.702922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:27.702888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:35.295878 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:35.295841    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:40.742451 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.742389    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"]
Aug 04 12:03:40.742828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.742792    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fc115b-058d-4045-95f6-6af274f476ce" containerName="main"
Aug 04 12:03:40.742828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.742803    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fc115b-058d-4045-95f6-6af274f476ce" containerName="main"
Aug 04 12:03:40.742905 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.742873    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fc115b-058d-4045-95f6-6af274f476ce" containerName="main"
Aug 04 12:03:40.745930 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.745914    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.748003 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.747984    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7db38b79-openshift-default-dockercfg-6jgd9\""
Aug 04 12:03:40.789046 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-credential-socket\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789222 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-certs\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789222 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-podinfo\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789222 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-socket\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789355 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-envoy\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789355 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-token\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789355 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istiod-ca-cert\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789530 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmnv7\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-kube-api-access-cmnv7\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.789530 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.789439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-data\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.809805 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.809767    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"]
Aug 04 12:03:40.890284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-podinfo\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-socket\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890601 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-envoy\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890601 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-token\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890601 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istiod-ca-cert\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890758 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmnv7\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-kube-api-access-cmnv7\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890758 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-data\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890758 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-credential-socket\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890898 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-socket\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.890898 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.890778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-certs\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.891023 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.891003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-data\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.891104 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.891085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-certs\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.891199 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.891179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-credential-socket\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.891479 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.891459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istiod-ca-cert\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.892962 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.892934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-envoy\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.893303 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.893281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-podinfo\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.901764 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.901737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-token\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:40.901917 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:40.901896    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmnv7\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-kube-api-access-cmnv7\") pod \"e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") " pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:41.055873 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.055771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:41.210047 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.210013    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"]
Aug 04 12:03:41.212250 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:03:41.212220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5d21f9_9e81_4510_8311_e65fe4a4c887.slice/crio-f142cbd475f1a569c8601cf899fa056036a97571525ef764965f39801fbb7d7a WatchSource:0}: Error finding container f142cbd475f1a569c8601cf899fa056036a97571525ef764965f39801fbb7d7a: Status 404 returned error can't find the container with id f142cbd475f1a569c8601cf899fa056036a97571525ef764965f39801fbb7d7a
Aug 04 12:03:41.214518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.214484    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:03:41.214593 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.214551    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:03:41.214638 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.214600    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:03:41.434670 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.434631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" event={"ID":"8a5d21f9-9e81-4510-8311-e65fe4a4c887","Type":"ContainerStarted","Data":"a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"}
Aug 04 12:03:41.434860 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.434696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" event={"ID":"8a5d21f9-9e81-4510-8311-e65fe4a4c887","Type":"ContainerStarted","Data":"f142cbd475f1a569c8601cf899fa056036a97571525ef764965f39801fbb7d7a"}
Aug 04 12:03:41.455696 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:41.455633    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podStartSLOduration=1.4556120940000001 podStartE2EDuration="1.455612094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:03:41.454469085 +0000 UTC m=+1829.628955087" watchObservedRunningTime="2026-08-04 12:03:41.455612094 +0000 UTC m=+1829.630098097"
Aug 04 12:03:42.056827 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:42.056788    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:42.061681 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:42.061654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:42.441265 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:42.441229    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:42.442369 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:42.442341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:47.394888 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:47.394848    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:03:57.442555 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.442522    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 12:03:57.442987 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.442585    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 12:03:57.522696 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.522663    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerID="a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd" exitCode=0
Aug 04 12:03:57.522864 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.522706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" event={"ID":"8a5d21f9-9e81-4510-8311-e65fe4a4c887","Type":"ContainerDied","Data":"a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"}
Aug 04 12:03:57.523094 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.523079    2582 scope.go:117] "RemoveContainer" containerID="a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"
Aug 04 12:03:57.524153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.524122    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:03:57.524214 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.524203    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:03:57.524258 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:57.524238    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:03:58.530010 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:58.529973    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" event={"ID":"8a5d21f9-9e81-4510-8311-e65fe4a4c887","Type":"ContainerStarted","Data":"2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8"}
Aug 04 12:03:59.056564 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:59.056531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:03:59.057019 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:59.056994    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 12:03:59.057208 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:03:59.057183    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 12:04:00.056775 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:00.056734    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 12:04:00.057397 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:00.057362    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 12:04:01.057043 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:01.057002    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 12:04:01.057667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:01.057635    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 12:04:02.056583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:02.056536    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 12:04:02.056800 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:02.056611    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 12:04:03.057014 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:03.056975    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Aug 04 12:04:03.057644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:03.057613    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Aug 04 12:04:04.059955 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:04.059923    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:04:04.060314 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:04.060172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:04:04.060922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:04.060904    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:04:14.659466 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:14.659427    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"]
Aug 04 12:04:14.659948 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:14.659702    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" containerID="cri-o://2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8" gracePeriod=30
Aug 04 12:04:15.668293 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.668260    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"]
Aug 04 12:04:15.671929 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.671904    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.675908 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.675889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b6e21d41-gw-openshift-default-dockercfg-lrv4l\""
Aug 04 12:04:15.690677 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.690656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"]
Aug 04 12:04:15.720694 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720670    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-data\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.720833 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-certs\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.720833 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-envoy\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.720833 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9lkn\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-kube-api-access-s9lkn\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.720833 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/116f5223-71a6-46eb-9404-238c9b0ebf87-istiod-ca-cert\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.721032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-socket\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.721032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-credential-socket\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.721032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-podinfo\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.721032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.720978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-token\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.821856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.821814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-podinfo\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.821856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.821862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-token\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.821931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-data\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.821982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-certs\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-envoy\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9lkn\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-kube-api-access-s9lkn\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/116f5223-71a6-46eb-9404-238c9b0ebf87-istiod-ca-cert\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-socket\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822457 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-credential-socket\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-data\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822576 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-certs\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822633 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-socket\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822691 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-credential-socket\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.822932 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.822911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/116f5223-71a6-46eb-9404-238c9b0ebf87-istiod-ca-cert\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.824366 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.824341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-envoy\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.824486 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.824435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-podinfo\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.832485 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.832459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-token\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.832776 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.832756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9lkn\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-kube-api-access-s9lkn\") pod \"e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") " pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:15.982079 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:15.981989    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:16.117885 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.117858    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"]
Aug 04 12:04:16.119289 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:04:16.119264    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116f5223_71a6_46eb_9404_238c9b0ebf87.slice/crio-85906ce77597ed0df22920f40e442f7d4d8cee08342d8eded2217d79577a0a8f WatchSource:0}: Error finding container 85906ce77597ed0df22920f40e442f7d4d8cee08342d8eded2217d79577a0a8f: Status 404 returned error can't find the container with id 85906ce77597ed0df22920f40e442f7d4d8cee08342d8eded2217d79577a0a8f
Aug 04 12:04:16.121576 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.121543    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:16.121664 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.121610    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:16.121664 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.121638    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:16.634377 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.634338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" event={"ID":"116f5223-71a6-46eb-9404-238c9b0ebf87","Type":"ContainerStarted","Data":"9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"}
Aug 04 12:04:16.634557 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.634426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" event={"ID":"116f5223-71a6-46eb-9404-238c9b0ebf87","Type":"ContainerStarted","Data":"85906ce77597ed0df22920f40e442f7d4d8cee08342d8eded2217d79577a0a8f"}
Aug 04 12:04:16.657319 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.657256    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podStartSLOduration=1.657236653 podStartE2EDuration="1.657236653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:04:16.653556878 +0000 UTC m=+1864.828042881" watchObservedRunningTime="2026-08-04 12:04:16.657236653 +0000 UTC m=+1864.831722656"
Aug 04 12:04:16.982504 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:16.982423    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:17.199136 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:17.199104    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:04:17.988369 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:17.988336    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:18.645124 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:18.645092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:18.646107 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:18.646088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:19.062466 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.062372    2582 patch_prober.go:28] interesting pod/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:04:19.062853 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.062457    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:04:19.904958 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.904935    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:04:19.956750 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956682    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-socket\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956750 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-podinfo\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956750 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956734    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmnv7\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-kube-api-access-cmnv7\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956796    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-certs\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956850    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-envoy\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-data\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956901    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-credential-socket\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956924    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-token\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.956976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.956974    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istiod-ca-cert\") pod \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\" (UID: \"8a5d21f9-9e81-4510-8311-e65fe4a4c887\") "
Aug 04 12:04:19.957277 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957004    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:19.957277 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957205    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:19.957277 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:19.957509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957330    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:19.957509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957347    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:19.957509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957392    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:19.957509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957457    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:19.957667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.957525    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:04:19.959080 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.959058    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:19.959184 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.959088    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:04:19.959374 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.959356    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-kube-api-access-cmnv7" (OuterVolumeSpecName: "kube-api-access-cmnv7") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "kube-api-access-cmnv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:04:19.959453 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:19.959382    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a5d21f9-9e81-4510-8311-e65fe4a4c887" (UID: "8a5d21f9-9e81-4510-8311-e65fe4a4c887"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:04:20.057862 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.057833    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:20.057862 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.057857    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a5d21f9-9e81-4510-8311-e65fe4a4c887-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:20.057862 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.057866    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:20.058084 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.057875    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:20.058084 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.057883    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a5d21f9-9e81-4510-8311-e65fe4a4c887-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:20.058084 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.057891    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmnv7\" (UniqueName: \"kubernetes.io/projected/8a5d21f9-9e81-4510-8311-e65fe4a4c887-kube-api-access-cmnv7\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:20.657590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.657505    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerID="2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8" exitCode=0
Aug 04 12:04:20.657590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.657552    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"
Aug 04 12:04:20.658013 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.657584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" event={"ID":"8a5d21f9-9e81-4510-8311-e65fe4a4c887","Type":"ContainerDied","Data":"2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8"}
Aug 04 12:04:20.658013 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.657638    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk" event={"ID":"8a5d21f9-9e81-4510-8311-e65fe4a4c887","Type":"ContainerDied","Data":"f142cbd475f1a569c8601cf899fa056036a97571525ef764965f39801fbb7d7a"}
Aug 04 12:04:20.658013 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.657661    2582 scope.go:117] "RemoveContainer" containerID="2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8"
Aug 04 12:04:20.666563 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.666542    2582 scope.go:117] "RemoveContainer" containerID="a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"
Aug 04 12:04:20.674382 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.674359    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"]
Aug 04 12:04:20.675182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.675169    2582 scope.go:117] "RemoveContainer" containerID="2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8"
Aug 04 12:04:20.675454 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:04:20.675429    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8\": container with ID starting with 2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8 not found: ID does not exist" containerID="2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8"
Aug 04 12:04:20.675565 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.675462    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8"} err="failed to get container status \"2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8\": rpc error: code = NotFound desc = could not find container \"2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8\": container with ID starting with 2f565d6ea564caa59e486d0b63f964c8e22ea128c28ce4be43efc0b9aed3fff8 not found: ID does not exist"
Aug 04 12:04:20.675565 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.675485    2582 scope.go:117] "RemoveContainer" containerID="a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"
Aug 04 12:04:20.675705 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:04:20.675688    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd\": container with ID starting with a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd not found: ID does not exist" containerID="a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"
Aug 04 12:04:20.675755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.675713    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd"} err="failed to get container status \"a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd\": rpc error: code = NotFound desc = could not find container \"a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd\": container with ID starting with a8d2e4aaff77d0e77a78c97a955a21e28ded7b2f2d1ecf6f9613b8372a35edfd not found: ID does not exist"
Aug 04 12:04:20.679256 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:20.679235    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7db38b79-openshift-default-7ffd568bd8-tjjdk"]
Aug 04 12:04:22.354771 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:22.354724    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" path="/var/lib/kubelet/pods/8a5d21f9-9e81-4510-8311-e65fe4a4c887/volumes"
Aug 04 12:04:24.506026 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:24.505991    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:04:30.715914 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:30.715821    2582 generic.go:356] "Generic (PLEG): container finished" podID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerID="9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0" exitCode=0
Aug 04 12:04:30.715914 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:30.715893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" event={"ID":"116f5223-71a6-46eb-9404-238c9b0ebf87","Type":"ContainerDied","Data":"9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"}
Aug 04 12:04:30.716345 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:30.716302    2582 scope.go:117] "RemoveContainer" containerID="9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"
Aug 04 12:04:30.717420 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:30.717378    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:30.717514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:30.717486    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:30.717554 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:30.717541    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:31.723462 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:31.723425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" event={"ID":"116f5223-71a6-46eb-9404-238c9b0ebf87","Type":"ContainerStarted","Data":"97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127"}
Aug 04 12:04:31.982882 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:31.982789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:31.984017 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:31.983988    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 12:04:31.984149 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:31.984036    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 12:04:32.983266 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:32.983226    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 12:04:32.983731 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:32.983287    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 12:04:33.645387 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:33.645326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:33.982975 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:33.982887    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 12:04:33.982975 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:33.982944    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 12:04:34.982934 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:34.982901    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 12:04:34.983328 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:34.982953    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 12:04:35.982951 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:35.982912    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 12:04:35.983362 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:35.982969    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 12:04:36.982824 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:36.982783    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 04 12:04:36.982999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:36.982848    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 04 12:04:37.987093 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:37.987064    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:37.988028 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:37.988012    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:49.156732 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.156692    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"]
Aug 04 12:04:49.157336 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.156954    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" containerID="cri-o://97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127" gracePeriod=30
Aug 04 12:04:49.932586 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.932556    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"]
Aug 04 12:04:49.932960 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.932947    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy"
Aug 04 12:04:49.933033 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.932962    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy"
Aug 04 12:04:49.933033 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.932970    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy"
Aug 04 12:04:49.933033 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.932976    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy"
Aug 04 12:04:49.933136 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.933063    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy"
Aug 04 12:04:49.933136 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.933074    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5d21f9-9e81-4510-8311-e65fe4a4c887" containerName="istio-proxy"
Aug 04 12:04:49.936333 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.936309    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:49.938099 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.938080    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-34f15601-openshift-default-dockercfg-qxf6f\""
Aug 04 12:04:49.949375 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:49.949341    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"]
Aug 04 12:04:50.033831 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.033788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlmkb\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-kube-api-access-vlmkb\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.033848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-envoy\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.033905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-credential-socket\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.033928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-data\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.033959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-certs\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.033985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-socket\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034291 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.034156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istiod-ca-cert\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034291 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.034232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-podinfo\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.034291 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.034259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-token\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135080 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istiod-ca-cert\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-podinfo\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-token\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlmkb\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-kube-api-access-vlmkb\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-envoy\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-credential-socket\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-data\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-certs\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135660 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-socket\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135813 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-certs\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.135956 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.135929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istiod-ca-cert\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.136062 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.136037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-socket\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.136193 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.136113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-credential-socket\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.136262 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.136218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-data\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.146423 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.138056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-envoy\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.147135 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.147084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-podinfo\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.149628 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.149566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-token\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.149905 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.149880    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlmkb\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-kube-api-access-vlmkb\") pod \"e2e-ait-34f15601-openshift-default-f98d86864-69bqr\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") " pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.246822 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.246740    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:50.388390 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.388364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"]
Aug 04 12:04:50.389771 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:04:50.389744    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77fe4c0_8840_42a7_ac7d_22c9539941b7.slice/crio-72183a9b5702752fa689848a2f5280dc0dccc399f36518ee37382b73ffb2a9b7 WatchSource:0}: Error finding container 72183a9b5702752fa689848a2f5280dc0dccc399f36518ee37382b73ffb2a9b7: Status 404 returned error can't find the container with id 72183a9b5702752fa689848a2f5280dc0dccc399f36518ee37382b73ffb2a9b7
Aug 04 12:04:50.391911 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.391873    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:50.391985 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.391948    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:50.391985 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.391975    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:04:50.795723 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.795693    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:04:50.834194 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.834155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" event={"ID":"c77fe4c0-8840-42a7-ac7d-22c9539941b7","Type":"ContainerStarted","Data":"508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"}
Aug 04 12:04:50.834390 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.834209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" event={"ID":"c77fe4c0-8840-42a7-ac7d-22c9539941b7","Type":"ContainerStarted","Data":"72183a9b5702752fa689848a2f5280dc0dccc399f36518ee37382b73ffb2a9b7"}
Aug 04 12:04:50.854486 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:50.854437    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podStartSLOduration=1.854422099 podStartE2EDuration="1.854422099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:04:50.851652246 +0000 UTC m=+1899.026138249" watchObservedRunningTime="2026-08-04 12:04:50.854422099 +0000 UTC m=+1899.028908094"
Aug 04 12:04:51.247149 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:51.247113    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:51.252677 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:51.252651    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:51.840832 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:51.840803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:51.841791 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:51.841772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:04:52.990198 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:52.990161    2582 patch_prober.go:28] interesting pod/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:04:52.990596 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:52.990215    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:04:54.409710 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.409684    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:54.580080 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.579998    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-credential-socket\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580080 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-socket\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9lkn\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-kube-api-access-s9lkn\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-token\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-data\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580169    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-podinfo\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580236    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-envoy\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580264    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/116f5223-71a6-46eb-9404-238c9b0ebf87-istiod-ca-cert\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580305 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-certs\") pod \"116f5223-71a6-46eb-9404-238c9b0ebf87\" (UID: \"116f5223-71a6-46eb-9404-238c9b0ebf87\") "
Aug 04 12:04:54.580712 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580323    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:54.580712 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580606    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.580712 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:54.580873 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580734    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/116f5223-71a6-46eb-9404-238c9b0ebf87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:04:54.580933 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580800    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:54.580933 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.580850    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-data" (OuterVolumeSpecName: "istio-data") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:54.582503 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.582478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:04:54.582620 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.582528    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-token" (OuterVolumeSpecName: "istio-token") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:04:54.582663 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.582613    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:04:54.582759 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.582740    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-kube-api-access-s9lkn" (OuterVolumeSpecName: "kube-api-access-s9lkn") pod "116f5223-71a6-46eb-9404-238c9b0ebf87" (UID: "116f5223-71a6-46eb-9404-238c9b0ebf87"). InnerVolumeSpecName "kube-api-access-s9lkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:04:54.681561 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681530    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681561 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681556    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9lkn\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-kube-api-access-s9lkn\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681561 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681567    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681575    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681583    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681591    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681598    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/116f5223-71a6-46eb-9404-238c9b0ebf87-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.681784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.681605    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/116f5223-71a6-46eb-9404-238c9b0ebf87-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:04:54.858056 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.858021    2582 generic.go:356] "Generic (PLEG): container finished" podID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerID="97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127" exitCode=0
Aug 04 12:04:54.858221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.858077    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"
Aug 04 12:04:54.858221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.858105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" event={"ID":"116f5223-71a6-46eb-9404-238c9b0ebf87","Type":"ContainerDied","Data":"97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127"}
Aug 04 12:04:54.858221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.858189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht" event={"ID":"116f5223-71a6-46eb-9404-238c9b0ebf87","Type":"ContainerDied","Data":"85906ce77597ed0df22920f40e442f7d4d8cee08342d8eded2217d79577a0a8f"}
Aug 04 12:04:54.858221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.858214    2582 scope.go:117] "RemoveContainer" containerID="97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127"
Aug 04 12:04:54.868349 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.868324    2582 scope.go:117] "RemoveContainer" containerID="9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"
Aug 04 12:04:54.878867 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.878844    2582 scope.go:117] "RemoveContainer" containerID="97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127"
Aug 04 12:04:54.879573 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:04:54.879550    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127\": container with ID starting with 97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127 not found: ID does not exist" containerID="97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127"
Aug 04 12:04:54.879674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.879585    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127"} err="failed to get container status \"97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127\": rpc error: code = NotFound desc = could not find container \"97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127\": container with ID starting with 97145d279058fea9ad8788d434da29ca788fc1615971b8297e84483ac30c7127 not found: ID does not exist"
Aug 04 12:04:54.879674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.879607    2582 scope.go:117] "RemoveContainer" containerID="9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"
Aug 04 12:04:54.879941 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:04:54.879898    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0\": container with ID starting with 9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0 not found: ID does not exist" containerID="9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"
Aug 04 12:04:54.880066 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.879947    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0"} err="failed to get container status \"9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0\": rpc error: code = NotFound desc = could not find container \"9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0\": container with ID starting with 9173c7b9f01c23defc859921c7289da98b67f9da9fc1d92bef29d2d34a6b32d0 not found: ID does not exist"
Aug 04 12:04:54.882822 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.882798    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"]
Aug 04 12:04:54.888915 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:54.888896    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b6e21d41-gw-openshift-default-c7f667c88-w4wht"]
Aug 04 12:04:56.351032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:56.350998    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" path="/var/lib/kubelet/pods/116f5223-71a6-46eb-9404-238c9b0ebf87/volumes"
Aug 04 12:04:56.691821 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:04:56.691735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:05:06.842394 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.842352    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 12:05:06.842831 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.842425    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 12:05:06.925883 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.925850    2582 generic.go:356] "Generic (PLEG): container finished" podID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerID="508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b" exitCode=0
Aug 04 12:05:06.926073 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.925891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" event={"ID":"c77fe4c0-8840-42a7-ac7d-22c9539941b7","Type":"ContainerDied","Data":"508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"}
Aug 04 12:05:06.926337 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.926319    2582 scope.go:117] "RemoveContainer" containerID="508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"
Aug 04 12:05:06.927357 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.927329    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:06.927492 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.927442    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:06.927561 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:06.927502    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:07.932961 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:07.932922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" event={"ID":"c77fe4c0-8840-42a7-ac7d-22c9539941b7","Type":"ContainerStarted","Data":"9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43"}
Aug 04 12:05:08.248063 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:08.247907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:05:08.248063 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:08.247959    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 12:05:08.248063 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:08.248015    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 12:05:09.248068 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:09.248028    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 12:05:09.248621 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:09.248100    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 12:05:10.247671 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:10.247631    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 12:05:10.247974 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:10.247938    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 12:05:11.248302 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:11.248252    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 12:05:11.248802 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:11.248328    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 12:05:12.248203 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:12.248154    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Aug 04 12:05:12.248444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:12.248236    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Aug 04 12:05:13.251707 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:13.251671    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:05:13.252154 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:13.251970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:05:13.252736 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:13.252720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:05:25.249910 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.249877    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"]
Aug 04 12:05:25.250450 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.250114    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" containerID="cri-o://9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43" gracePeriod=30
Aug 04 12:05:25.965692 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.965657    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"]
Aug 04 12:05:25.966069 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.966056    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy"
Aug 04 12:05:25.966120 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.966070    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy"
Aug 04 12:05:25.966120 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.966082    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy"
Aug 04 12:05:25.966120 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.966089    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy"
Aug 04 12:05:25.966228 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.966182    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy"
Aug 04 12:05:25.966228 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.966191    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="116f5223-71a6-46eb-9404-238c9b0ebf87" containerName="istio-proxy"
Aug 04 12:05:25.969288 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.969269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:25.971999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.971969    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b9abcfc3-openshift-default-dockercfg-66x7w\""
Aug 04 12:05:25.985930 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:25.985898    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"]
Aug 04 12:05:26.091012 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.090968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09eb915d-c473-4340-b25f-efdc19402275-istiod-ca-cert\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091213 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-istio-token\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091213 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09eb915d-c473-4340-b25f-efdc19402275-istio-podinfo\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091213 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-credential-socket\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091213 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-socket\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091356 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdm59\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-kube-api-access-vdm59\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091356 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-certs\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091356 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-envoy\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.091478 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.091379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-data\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192307 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192266    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-credential-socket\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-socket\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdm59\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-kube-api-access-vdm59\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-certs\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-envoy\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-data\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09eb915d-c473-4340-b25f-efdc19402275-istiod-ca-cert\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-istio-token\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09eb915d-c473-4340-b25f-efdc19402275-istio-podinfo\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192968 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-credential-socket\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192968 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192787    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-socket\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.192968 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-certs\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.193129 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.192993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-data\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.193559 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.193354    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09eb915d-c473-4340-b25f-efdc19402275-istiod-ca-cert\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.195144 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.195121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-envoy\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.195244 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.195129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09eb915d-c473-4340-b25f-efdc19402275-istio-podinfo\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.200582 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.200554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-istio-token\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.201047 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.201026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdm59\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-kube-api-access-vdm59\") pod \"e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") " pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.279859 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.279763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:26.426945 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.426918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"]
Aug 04 12:05:26.429271 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:05:26.429229    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09eb915d_c473_4340_b25f_efdc19402275.slice/crio-c6e3c0294dbbc1e95659c924b5e2e923917eb554fea4ecd537146834f2a94e4a WatchSource:0}: Error finding container c6e3c0294dbbc1e95659c924b5e2e923917eb554fea4ecd537146834f2a94e4a: Status 404 returned error can't find the container with id c6e3c0294dbbc1e95659c924b5e2e923917eb554fea4ecd537146834f2a94e4a
Aug 04 12:05:26.432117 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.432079    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:26.432232 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.432176    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:26.432232 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.432224    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:26.803026 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:26.802980    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:05:27.057918 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:27.057820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" event={"ID":"09eb915d-c473-4340-b25f-efdc19402275","Type":"ContainerStarted","Data":"c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"}
Aug 04 12:05:27.057918 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:27.057874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" event={"ID":"09eb915d-c473-4340-b25f-efdc19402275","Type":"ContainerStarted","Data":"c6e3c0294dbbc1e95659c924b5e2e923917eb554fea4ecd537146834f2a94e4a"}
Aug 04 12:05:27.078656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:27.078601    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podStartSLOduration=2.07858295 podStartE2EDuration="2.07858295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:05:27.076841843 +0000 UTC m=+1935.251327846" watchObservedRunningTime="2026-08-04 12:05:27.07858295 +0000 UTC m=+1935.253068951"
Aug 04 12:05:27.280771 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:27.280731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:27.286191 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:27.286162    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:28.062946 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:28.062918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:28.064076 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:28.064047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:28.254606 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:28.254566    2582 patch_prober.go:28] interesting pod/e2e-ait-34f15601-openshift-default-f98d86864-69bqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:05:28.254759 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:28.254633    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:05:30.530078 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.529983    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:05:30.639097 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-socket\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639289 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639111    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlmkb\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-kube-api-access-vlmkb\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639289 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639251    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-token\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639420 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-credential-socket\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639420 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-envoy\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639533 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istiod-ca-cert\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639533 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639485    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-certs\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639533 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639442    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:05:30.639533 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-podinfo\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639731 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-data\") pod \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\" (UID: \"c77fe4c0-8840-42a7-ac7d-22c9539941b7\") "
Aug 04 12:05:30.639731 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639581    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:05:30.639827 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639734    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:05:30.639827 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639803    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:05:30.639987 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.639919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:05:30.640155 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.640060    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.640155 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.640093    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.640155 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.640107    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.640155 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.640120    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.640155 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.640134    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.641712 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.641683    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:05:30.641809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.641750    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:05:30.641809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.641785    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-kube-api-access-vlmkb" (OuterVolumeSpecName: "kube-api-access-vlmkb") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "kube-api-access-vlmkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:05:30.641962 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.641947    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c77fe4c0-8840-42a7-ac7d-22c9539941b7" (UID: "c77fe4c0-8840-42a7-ac7d-22c9539941b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:05:30.740947 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.740905    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.740947 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.740940    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.740947 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.740952    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlmkb\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-kube-api-access-vlmkb\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:30.741193 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:30.740966    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77fe4c0-8840-42a7-ac7d-22c9539941b7-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:05:31.081501 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.081465    2582 generic.go:356] "Generic (PLEG): container finished" podID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerID="9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43" exitCode=0
Aug 04 12:05:31.081709 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.081519    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"
Aug 04 12:05:31.081709 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.081550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" event={"ID":"c77fe4c0-8840-42a7-ac7d-22c9539941b7","Type":"ContainerDied","Data":"9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43"}
Aug 04 12:05:31.081709 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.081615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr" event={"ID":"c77fe4c0-8840-42a7-ac7d-22c9539941b7","Type":"ContainerDied","Data":"72183a9b5702752fa689848a2f5280dc0dccc399f36518ee37382b73ffb2a9b7"}
Aug 04 12:05:31.081709 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.081649    2582 scope.go:117] "RemoveContainer" containerID="9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43"
Aug 04 12:05:31.093787 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.093764    2582 scope.go:117] "RemoveContainer" containerID="508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"
Aug 04 12:05:31.102702 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.102684    2582 scope.go:117] "RemoveContainer" containerID="9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43"
Aug 04 12:05:31.102992 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:05:31.102972    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43\": container with ID starting with 9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43 not found: ID does not exist" containerID="9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43"
Aug 04 12:05:31.103068 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.103001    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43"} err="failed to get container status \"9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43\": rpc error: code = NotFound desc = could not find container \"9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43\": container with ID starting with 9f57dad864f27c037ee6719d70e20aeb288ae29d438207d5491f20f9f96d2a43 not found: ID does not exist"
Aug 04 12:05:31.103068 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.103019    2582 scope.go:117] "RemoveContainer" containerID="508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"
Aug 04 12:05:31.103236 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:05:31.103218    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b\": container with ID starting with 508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b not found: ID does not exist" containerID="508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"
Aug 04 12:05:31.103278 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.103244    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b"} err="failed to get container status \"508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b\": rpc error: code = NotFound desc = could not find container \"508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b\": container with ID starting with 508824dd0d1e0649baa1c3fff90377c0b57a3772d09dcd4d731daa0525afbe6b not found: ID does not exist"
Aug 04 12:05:31.123156 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.123117    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"]
Aug 04 12:05:31.149039 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:31.149006    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-34f15601-openshift-default-f98d86864-69bqr"]
Aug 04 12:05:32.350890 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:32.350858    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" path="/var/lib/kubelet/pods/c77fe4c0-8840-42a7-ac7d-22c9539941b7/volumes"
Aug 04 12:05:32.795913 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:32.795819    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:05:43.064883 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.064841    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 12:05:43.065325 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.064910    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 12:05:43.146566 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.146532    2582 generic.go:356] "Generic (PLEG): container finished" podID="09eb915d-c473-4340-b25f-efdc19402275" containerID="c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391" exitCode=0
Aug 04 12:05:43.146746 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.146606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" event={"ID":"09eb915d-c473-4340-b25f-efdc19402275","Type":"ContainerDied","Data":"c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"}
Aug 04 12:05:43.147012 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.146999    2582 scope.go:117] "RemoveContainer" containerID="c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"
Aug 04 12:05:43.148109 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.148079    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:43.148211 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.148151    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:43.148211 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:43.148185    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:05:44.159146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:44.159107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" event={"ID":"09eb915d-c473-4340-b25f-efdc19402275","Type":"ContainerStarted","Data":"07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036"}
Aug 04 12:05:44.280553 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:44.280523    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:44.280760 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:44.280738    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 12:05:44.280806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:44.280784    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 12:05:45.280896 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:45.280851    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 12:05:45.281400 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:45.280919    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 12:05:46.280782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:46.280740    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 12:05:46.280995 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:46.280809    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 12:05:47.280868 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:47.280824    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 12:05:47.281051 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:47.280890    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 12:05:48.281112 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:48.281077    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Aug 04 12:05:48.281532 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:48.281138    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Aug 04 12:05:49.284685 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:49.284646    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:49.285157 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:49.285010    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:05:49.285780 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:05:49.285764    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:06:00.588673 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:00.588632    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"]
Aug 04 12:06:00.589309 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:00.588946    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" containerID="cri-o://07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036" gracePeriod=30
Aug 04 12:06:03.202231 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:03.202193    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:06:04.287646 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:04.287556    2582 patch_prober.go:28] interesting pod/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 04 12:06:04.287646 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:04.287626    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:06:05.852602 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.852570    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:06:05.976304 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976206    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-data\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976304 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976249    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-istio-token\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976304 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdm59\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-kube-api-access-vdm59\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976328    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09eb915d-c473-4340-b25f-efdc19402275-istiod-ca-cert\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09eb915d-c473-4340-b25f-efdc19402275-istio-podinfo\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976432    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-socket\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-certs\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976490    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-envoy\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976521    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-credential-socket\") pod \"09eb915d-c473-4340-b25f-efdc19402275\" (UID: \"09eb915d-c473-4340-b25f-efdc19402275\") "
Aug 04 12:06:05.976623 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-data" (OuterVolumeSpecName: "istio-data") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:06:05.976942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976740    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:06:05.976942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976786    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:06:05.976942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976870    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09eb915d-c473-4340-b25f-efdc19402275-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:06:05.976942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976878    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:05.976942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976920    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:05.977153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.976973    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:06:05.978632 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.978610    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-istio-token" (OuterVolumeSpecName: "istio-token") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:06:05.978756 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.978693    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09eb915d-c473-4340-b25f-efdc19402275-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:06:05.978819 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.978758    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:06:05.978872 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:05.978833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-kube-api-access-vdm59" (OuterVolumeSpecName: "kube-api-access-vdm59") pod "09eb915d-c473-4340-b25f-efdc19402275" (UID: "09eb915d-c473-4340-b25f-efdc19402275"). InnerVolumeSpecName "kube-api-access-vdm59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:06:06.077493 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077458    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.077493 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077490    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.077493 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077501    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdm59\" (UniqueName: \"kubernetes.io/projected/09eb915d-c473-4340-b25f-efdc19402275-kube-api-access-vdm59\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.077777 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077511    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09eb915d-c473-4340-b25f-efdc19402275-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.077777 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077520    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09eb915d-c473-4340-b25f-efdc19402275-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.077777 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077528    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.077777 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.077535    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09eb915d-c473-4340-b25f-efdc19402275-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:06:06.281169 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.281070    2582 generic.go:356] "Generic (PLEG): container finished" podID="09eb915d-c473-4340-b25f-efdc19402275" containerID="07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036" exitCode=0
Aug 04 12:06:06.281169 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.281137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" event={"ID":"09eb915d-c473-4340-b25f-efdc19402275","Type":"ContainerDied","Data":"07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036"}
Aug 04 12:06:06.281169 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.281142    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"
Aug 04 12:06:06.281569 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.281204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7" event={"ID":"09eb915d-c473-4340-b25f-efdc19402275","Type":"ContainerDied","Data":"c6e3c0294dbbc1e95659c924b5e2e923917eb554fea4ecd537146834f2a94e4a"}
Aug 04 12:06:06.281569 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.281225    2582 scope.go:117] "RemoveContainer" containerID="07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036"
Aug 04 12:06:06.290806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.290787    2582 scope.go:117] "RemoveContainer" containerID="c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"
Aug 04 12:06:06.300129 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.300108    2582 scope.go:117] "RemoveContainer" containerID="07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036"
Aug 04 12:06:06.300465 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:06:06.300443    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036\": container with ID starting with 07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036 not found: ID does not exist" containerID="07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036"
Aug 04 12:06:06.300561 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.300479    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036"} err="failed to get container status \"07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036\": rpc error: code = NotFound desc = could not find container \"07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036\": container with ID starting with 07efed214598cd8b1b12098177aebf4e2df7c53d52cc78e1c24bf213d7625036 not found: ID does not exist"
Aug 04 12:06:06.300561 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.300504    2582 scope.go:117] "RemoveContainer" containerID="c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"
Aug 04 12:06:06.300757 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:06:06.300737    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391\": container with ID starting with c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391 not found: ID does not exist" containerID="c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"
Aug 04 12:06:06.300797 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.300763    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391"} err="failed to get container status \"c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391\": rpc error: code = NotFound desc = could not find container \"c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391\": container with ID starting with c44eeca8407a045b81fd1b2c1d25243736183189207cc98bbe1fe3a02da05391 not found: ID does not exist"
Aug 04 12:06:06.305473 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.305447    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"]
Aug 04 12:06:06.313044 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.313018    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b9abcfc3-openshift-default-5f46d9455b-rp2t7"]
Aug 04 12:06:06.350944 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:06.350912    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09eb915d-c473-4340-b25f-efdc19402275" path="/var/lib/kubelet/pods/09eb915d-c473-4340-b25f-efdc19402275/volumes"
Aug 04 12:06:10.699126 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:10.699081    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:06:17.308320 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:06:17.308278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:07:47.225721 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:07:47.225634    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:07:54.895590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:07:54.895556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:08:00.209014 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.208978    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"]
Aug 04 12:08:00.209514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.209366    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy"
Aug 04 12:08:00.209514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.209376    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy"
Aug 04 12:08:00.209514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.209393    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy"
Aug 04 12:08:00.209514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.209399    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy"
Aug 04 12:08:00.209514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.209477    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy"
Aug 04 12:08:00.209514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.209488    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy"
Aug 04 12:08:00.212581 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.212561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.215504 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.215481    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6958d802-openshift-default-dockercfg-sgjdq\""
Aug 04 12:08:00.240717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.240683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"]
Aug 04 12:08:00.252946 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.252916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c758535-0147-482e-82e8-80918fc2a392-istiod-ca-cert\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.252955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-istio-token\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.252982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-certs\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.253008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-data\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.253034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c758535-0147-482e-82e8-80918fc2a392-istio-podinfo\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.253071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hblm\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-kube-api-access-9hblm\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.253099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-socket\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.253146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-envoy\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.253597 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.253170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-credential-socket\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.353755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.353722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c758535-0147-482e-82e8-80918fc2a392-istio-podinfo\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.353755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.353760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hblm\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-kube-api-access-9hblm\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.353989 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.353946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-socket\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354048 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-envoy\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-credential-socket\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c758535-0147-482e-82e8-80918fc2a392-istiod-ca-cert\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-istio-token\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-certs\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-data\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-socket\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-credential-socket\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-data\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.354855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.354780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-certs\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.355281 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.355063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c758535-0147-482e-82e8-80918fc2a392-istiod-ca-cert\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.356701 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.356670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c758535-0147-482e-82e8-80918fc2a392-istio-podinfo\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.356701 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.356682    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-envoy\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.362020 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.361997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hblm\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-kube-api-access-9hblm\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.362169 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.362149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-istio-token\") pod \"e2e-mt-6958d802-openshift-default-7c46d7c684-td22h\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") " pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.524974 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.524894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:00.675101 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.675074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"]
Aug 04 12:08:00.676106 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:08:00.676081    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c758535_0147_482e_82e8_80918fc2a392.slice/crio-6d6dc79be9ff97eb56c2566180e1764adb32b79565fd2ec07048ae6e290cac30 WatchSource:0}: Error finding container 6d6dc79be9ff97eb56c2566180e1764adb32b79565fd2ec07048ae6e290cac30: Status 404 returned error can't find the container with id 6d6dc79be9ff97eb56c2566180e1764adb32b79565fd2ec07048ae6e290cac30
Aug 04 12:08:00.680929 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.680887    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:08:00.681023 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.680980    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:08:00.681065 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.681023    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:08:00.910297 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.910256    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" event={"ID":"8c758535-0147-482e-82e8-80918fc2a392","Type":"ContainerStarted","Data":"6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"}
Aug 04 12:08:00.910528 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.910324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" event={"ID":"8c758535-0147-482e-82e8-80918fc2a392","Type":"ContainerStarted","Data":"6d6dc79be9ff97eb56c2566180e1764adb32b79565fd2ec07048ae6e290cac30"}
Aug 04 12:08:00.929765 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:00.929697    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podStartSLOduration=0.929673991 podStartE2EDuration="929.673991ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:08:00.929088039 +0000 UTC m=+2089.103574041" watchObservedRunningTime="2026-08-04 12:08:00.929673991 +0000 UTC m=+2089.104159995"
Aug 04 12:08:01.525227 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:01.525190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:01.529993 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:01.529963    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:01.916549 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:01.916516    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:01.917600 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:01.917577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:07.795231 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:07.795192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:08:17.572971 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:17.572811    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:33404->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Aug 04 12:08:17.572971 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:17.572906    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:33404->10.134.0.51:15021: read: connection reset by peer"
Aug 04 12:08:18.011582 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:18.011539    2582 generic.go:356] "Generic (PLEG): container finished" podID="8c758535-0147-482e-82e8-80918fc2a392" containerID="6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf" exitCode=0
Aug 04 12:08:18.011765 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:18.011609    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" event={"ID":"8c758535-0147-482e-82e8-80918fc2a392","Type":"ContainerDied","Data":"6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"}
Aug 04 12:08:18.012118 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:18.012102    2582 scope.go:117] "RemoveContainer" containerID="6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"
Aug 04 12:08:18.013207 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:18.013176    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:08:18.013279 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:18.013264    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:08:18.013322 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:18.013303    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:08:19.018951 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:19.018916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" event={"ID":"8c758535-0147-482e-82e8-80918fc2a392","Type":"ContainerStarted","Data":"4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0"}
Aug 04 12:08:19.525590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:19.525548    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:19.525821 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:19.525797    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 12:08:19.525882 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:19.525861    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 12:08:20.525486 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:20.525446    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 12:08:20.525891 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:20.525519    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 12:08:21.525918 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:21.525879    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 12:08:21.526346 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:21.525948    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 12:08:22.525579 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:22.525540    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 12:08:22.525786 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:22.525601    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 12:08:23.525513 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:23.525470    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Aug 04 12:08:23.525917 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:23.525532    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Aug 04 12:08:24.529841 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:24.529810    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:24.530253 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:24.530074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:24.530786 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:24.530770    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:47.795871 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:47.795827    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:08:52.490885 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:52.490846    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"]
Aug 04 12:08:52.491379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:52.491089    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" containerID="cri-o://4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0" gracePeriod=30
Aug 04 12:08:54.532480 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:54.532438    2582 patch_prober.go:28] interesting pod/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:08:54.532951 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:54.532529    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:08:57.742949 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.742920    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:57.832326 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832223    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-certs\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832326 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832271    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c758535-0147-482e-82e8-80918fc2a392-istio-podinfo\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832326 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832301    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-envoy\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832330    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-data\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hblm\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-kube-api-access-9hblm\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832397    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-socket\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832452    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c758535-0147-482e-82e8-80918fc2a392-istiod-ca-cert\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832510    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-istio-token\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832542    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:08:57.832644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832570    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-credential-socket\") pod \"8c758535-0147-482e-82e8-80918fc2a392\" (UID: \"8c758535-0147-482e-82e8-80918fc2a392\") "
Aug 04 12:08:57.832983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832862    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:08:57.832983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832877    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:08:57.832983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.832943    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c758535-0147-482e-82e8-80918fc2a392-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:08:57.833111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.833006    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.833111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.833024    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.833111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.833038    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.833111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.833091    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:08:57.834760 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.834730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-kube-api-access-9hblm" (OuterVolumeSpecName: "kube-api-access-9hblm") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "kube-api-access-9hblm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:08:57.834912 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.834852    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:08:57.835108 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.835084    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:08:57.835164 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.835125    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c758535-0147-482e-82e8-80918fc2a392-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c758535-0147-482e-82e8-80918fc2a392" (UID: "8c758535-0147-482e-82e8-80918fc2a392"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:08:57.933562 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.933522    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c758535-0147-482e-82e8-80918fc2a392-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.933562 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.933554    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.933562 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.933564    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c758535-0147-482e-82e8-80918fc2a392-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.933562 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.933573    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hblm\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-kube-api-access-9hblm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.933850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.933582    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c758535-0147-482e-82e8-80918fc2a392-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:57.933850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:57.933590    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c758535-0147-482e-82e8-80918fc2a392-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:08:58.241687 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.241654    2582 generic.go:356] "Generic (PLEG): container finished" podID="8c758535-0147-482e-82e8-80918fc2a392" containerID="4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0" exitCode=0
Aug 04 12:08:58.241844 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.241702    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"
Aug 04 12:08:58.241844 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.241729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" event={"ID":"8c758535-0147-482e-82e8-80918fc2a392","Type":"ContainerDied","Data":"4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0"}
Aug 04 12:08:58.241844 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.241814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h" event={"ID":"8c758535-0147-482e-82e8-80918fc2a392","Type":"ContainerDied","Data":"6d6dc79be9ff97eb56c2566180e1764adb32b79565fd2ec07048ae6e290cac30"}
Aug 04 12:08:58.241844 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.241839    2582 scope.go:117] "RemoveContainer" containerID="4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0"
Aug 04 12:08:58.251906 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.251879    2582 scope.go:117] "RemoveContainer" containerID="6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"
Aug 04 12:08:58.260979 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.260955    2582 scope.go:117] "RemoveContainer" containerID="4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0"
Aug 04 12:08:58.261340 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:08:58.261303    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0\": container with ID starting with 4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0 not found: ID does not exist" containerID="4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0"
Aug 04 12:08:58.261442 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.261353    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0"} err="failed to get container status \"4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0\": rpc error: code = NotFound desc = could not find container \"4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0\": container with ID starting with 4f2d4e929e6304f69aead94dc3e35bbe167c169e0dac35410be17facade487f0 not found: ID does not exist"
Aug 04 12:08:58.261442 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.261379    2582 scope.go:117] "RemoveContainer" containerID="6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"
Aug 04 12:08:58.261741 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:08:58.261686    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf\": container with ID starting with 6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf not found: ID does not exist" containerID="6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"
Aug 04 12:08:58.261741 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.261718    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf"} err="failed to get container status \"6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf\": rpc error: code = NotFound desc = could not find container \"6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf\": container with ID starting with 6cf36bed4445b2f80283a10d91a28bf75ad1b23872bf997ce391153b44d564cf not found: ID does not exist"
Aug 04 12:08:58.263506 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.263483    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"]
Aug 04 12:08:58.270497 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.270473    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6958d802-openshift-default-7c46d7c684-td22h"]
Aug 04 12:08:58.349531 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:08:58.349501    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c758535-0147-482e-82e8-80918fc2a392" path="/var/lib/kubelet/pods/8c758535-0147-482e-82e8-80918fc2a392/volumes"
Aug 04 12:09:26.698072 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:09:26.698032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:11:07.795199 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795143    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"]
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795626    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795640    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795655    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795674    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795681    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795694    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795699    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy"
Aug 04 12:11:07.795757 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795758    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="09eb915d-c473-4340-b25f-efdc19402275" containerName="istio-proxy"
Aug 04 12:11:07.796122 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795768    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy"
Aug 04 12:11:07.796122 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795775    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77fe4c0-8840-42a7-ac7d-22c9539941b7" containerName="istio-proxy"
Aug 04 12:11:07.796122 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.795780    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c758535-0147-482e-82e8-80918fc2a392" containerName="istio-proxy"
Aug 04 12:11:07.798692 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.798676    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.801026 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.801000    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f3708437-openshift-default-dockercfg-b5hfp\""
Aug 04 12:11:07.811120 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.811090    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"]
Aug 04 12:11:07.957765 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.957723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-socket\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.957983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.957794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-certs\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.957983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.957854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-podinfo\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.957983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.957917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-token\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.957983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.957958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64662a8-c909-442a-b1bd-667aab0ab56c-istiod-ca-cert\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.958212 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.957986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-envoy\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.958212 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.958032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmsp\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-kube-api-access-gtmsp\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.958212 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.958062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-data\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:07.958212 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:07.958099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-credential-socket\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.058809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.058713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-token\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.058809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.058767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64662a8-c909-442a-b1bd-667aab0ab56c-istiod-ca-cert\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.058809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.058806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-envoy\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.058841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmsp\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-kube-api-access-gtmsp\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.058998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-data\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-credential-socket\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059252 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-socket\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059252 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-certs\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059358 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-podinfo\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059512 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-data\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059512 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-credential-socket\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059681 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-socket\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059803 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-certs\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.059990 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.059965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64662a8-c909-442a-b1bd-667aab0ab56c-istiod-ca-cert\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.061676 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.061638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-envoy\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.061835 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.061817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-podinfo\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.066376 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.066346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-token\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.066905 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.066881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmsp\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-kube-api-access-gtmsp\") pod \"e2e-mt-f3708437-openshift-default-548f994dbd-74zs8\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") " pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.109851 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.109815    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:08.259905 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.259875    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"]
Aug 04 12:11:08.261921 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:11:08.261893    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64662a8_c909_442a_b1bd_667aab0ab56c.slice/crio-33c656103f680fdd8f51f8507ad41bd861198ec820d6d460ee1963e07a29b15f WatchSource:0}: Error finding container 33c656103f680fdd8f51f8507ad41bd861198ec820d6d460ee1963e07a29b15f: Status 404 returned error can't find the container with id 33c656103f680fdd8f51f8507ad41bd861198ec820d6d460ee1963e07a29b15f
Aug 04 12:11:08.264056 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.264015    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:11:08.264176 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.264098    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:11:08.264176 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.264145    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:11:08.930846 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.930806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" event={"ID":"f64662a8-c909-442a-b1bd-667aab0ab56c","Type":"ContainerStarted","Data":"0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"}
Aug 04 12:11:08.931364 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.930876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" event={"ID":"f64662a8-c909-442a-b1bd-667aab0ab56c","Type":"ContainerStarted","Data":"33c656103f680fdd8f51f8507ad41bd861198ec820d6d460ee1963e07a29b15f"}
Aug 04 12:11:08.950692 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:08.950637    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podStartSLOduration=1.950618856 podStartE2EDuration="1.950618856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:11:08.94865179 +0000 UTC m=+2277.123137786" watchObservedRunningTime="2026-08-04 12:11:08.950618856 +0000 UTC m=+2277.125104859"
Aug 04 12:11:09.110360 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:09.110315    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:09.115512 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:09.115482    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:09.937143 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:09.937107    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:09.938327 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:09.938305    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:10.897770 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:10.897729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:11:19.101693 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:19.101654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:11:25.800374 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:25.799289    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:35432->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Aug 04 12:11:25.800374 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:25.799354    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:35432->10.134.0.52:15021: read: connection reset by peer"
Aug 04 12:11:26.027045 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:26.026959    2582 generic.go:356] "Generic (PLEG): container finished" podID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerID="0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3" exitCode=0
Aug 04 12:11:26.027045 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:26.027032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" event={"ID":"f64662a8-c909-442a-b1bd-667aab0ab56c","Type":"ContainerDied","Data":"0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"}
Aug 04 12:11:26.027476 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:26.027463    2582 scope.go:117] "RemoveContainer" containerID="0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"
Aug 04 12:11:26.028542 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:26.028512    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:11:26.028617 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:26.028599    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:11:26.028660 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:26.028641    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:11:27.034881 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:27.034845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" event={"ID":"f64662a8-c909-442a-b1bd-667aab0ab56c","Type":"ContainerStarted","Data":"42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba"}
Aug 04 12:11:27.110181 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:27.110140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:27.110492 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:27.110467    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 12:11:27.110551 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:27.110520    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 12:11:28.111069 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:28.111027    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 12:11:28.111500 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:28.111100    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 12:11:29.110667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:29.110627    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 12:11:29.110855 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:29.110694    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 12:11:30.110797 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:30.110758    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 12:11:30.111282 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:30.110824    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 12:11:31.110613 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:31.110578    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Aug 04 12:11:31.110807 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:31.110649    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Aug 04 12:11:32.115032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:32.114998    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:32.115499 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:32.115441    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:32.116235 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:32.116214    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:11:58.589201 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.589169    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"]
Aug 04 12:11:58.592635 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.592618    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.595123 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.595101    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f3708437\"/\"kube-root-ca.crt\""
Aug 04 12:11:58.595234 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.595196    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f3708437\"/\"e2e-lifecycle-model-f3708437-kserve-self-signed-certs\""
Aug 04 12:11:58.595234 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.595220    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f3708437\"/\"openshift-service-ca.crt\""
Aug 04 12:11:58.595337 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.595231    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f3708437\"/\"default-dockercfg-xh4sx\""
Aug 04 12:11:58.602743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.602716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"]
Aug 04 12:11:58.756901 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.756870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-model-cache\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.756901 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.756902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfdm\" (UniqueName: \"kubernetes.io/projected/a33e5f59-5732-472b-80ff-9bac7e04e4bc-kube-api-access-pjfdm\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.757162 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.756941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-dshm\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.757162 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.756990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-home\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.757162 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.757008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tls-certs\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.757162 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.757103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tmp-dir\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.858348 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.858309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-model-cache\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.858556 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.858357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfdm\" (UniqueName: \"kubernetes.io/projected/a33e5f59-5732-472b-80ff-9bac7e04e4bc-kube-api-access-pjfdm\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.858556 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.858433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-dshm\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.858556 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.858477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-home\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.858556 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.858502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tls-certs\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.858795 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.858608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tmp-dir\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.859203 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.859173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-home\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.859824 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.859765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-model-cache\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.859949 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.859830    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tmp-dir\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.863147 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.861708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-dshm\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.864553 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.864508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tls-certs\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.870714 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.870687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfdm\" (UniqueName: \"kubernetes.io/projected/a33e5f59-5732-472b-80ff-9bac7e04e4bc-kube-api-access-pjfdm\") pod \"e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") " pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:58.902609 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:58.902581    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:11:59.032899 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:59.032872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"]
Aug 04 12:11:59.034597 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:11:59.034570    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda33e5f59_5732_472b_80ff_9bac7e04e4bc.slice/crio-89a82790b006bb03d550b1cf99587b1889f18f583cd007f0ad485d7078cbff99 WatchSource:0}: Error finding container 89a82790b006bb03d550b1cf99587b1889f18f583cd007f0ad485d7078cbff99: Status 404 returned error can't find the container with id 89a82790b006bb03d550b1cf99587b1889f18f583cd007f0ad485d7078cbff99
Aug 04 12:11:59.220681 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:59.220594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6" event={"ID":"a33e5f59-5732-472b-80ff-9bac7e04e4bc","Type":"ContainerStarted","Data":"108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece"}
Aug 04 12:11:59.220681 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:11:59.220642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6" event={"ID":"a33e5f59-5732-472b-80ff-9bac7e04e4bc","Type":"ContainerStarted","Data":"89a82790b006bb03d550b1cf99587b1889f18f583cd007f0ad485d7078cbff99"}
Aug 04 12:12:00.994777 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:00.994716    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6" podStartSLOduration=2.994699079 podStartE2EDuration="2.994699079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:11:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:11:59.236386981 +0000 UTC m=+2327.410872984" watchObservedRunningTime="2026-08-04 12:12:00.994699079 +0000 UTC m=+2329.169185081"
Aug 04 12:12:00.995154 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:00.994923    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:12:08.902893 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:08.902816    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:12:08.902893 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:08.902861    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:12:08.915648 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:08.915623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:12:09.287972 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:09.287889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:12:42.696298 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:12:42.696264    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:13:04.499244 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:04.499209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:13:10.000175 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:10.000139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:13:15.402917 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:15.402886    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"]
Aug 04 12:13:30.421932 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.421893    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6" podUID="a33e5f59-5732-472b-80ff-9bac7e04e4bc" containerName="main" containerID="cri-o://108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece" gracePeriod=45
Aug 04 12:13:30.674337 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.674279    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:13:30.703755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.703720    2582 generic.go:356] "Generic (PLEG): container finished" podID="a33e5f59-5732-472b-80ff-9bac7e04e4bc" containerID="108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece" exitCode=0
Aug 04 12:13:30.703960 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.703791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6" event={"ID":"a33e5f59-5732-472b-80ff-9bac7e04e4bc","Type":"ContainerDied","Data":"108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece"}
Aug 04 12:13:30.703960 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.703805    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"
Aug 04 12:13:30.703960 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.703830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6" event={"ID":"a33e5f59-5732-472b-80ff-9bac7e04e4bc","Type":"ContainerDied","Data":"89a82790b006bb03d550b1cf99587b1889f18f583cd007f0ad485d7078cbff99"}
Aug 04 12:13:30.703960 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.703853    2582 scope.go:117] "RemoveContainer" containerID="108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece"
Aug 04 12:13:30.714596 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.714572    2582 scope.go:117] "RemoveContainer" containerID="108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece"
Aug 04 12:13:30.714889 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:13:30.714862    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece\": container with ID starting with 108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece not found: ID does not exist" containerID="108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece"
Aug 04 12:13:30.714959 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.714906    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece"} err="failed to get container status \"108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece\": rpc error: code = NotFound desc = could not find container \"108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece\": container with ID starting with 108274c3fc38bd1716b593869f466a8261c0f2bd724df5bf1f2fc03bdcb2bece not found: ID does not exist"
Aug 04 12:13:30.789126 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-home\") pod \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") "
Aug 04 12:13:30.789126 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789134    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tmp-dir\") pod \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") "
Aug 04 12:13:30.789378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjfdm\" (UniqueName: \"kubernetes.io/projected/a33e5f59-5732-472b-80ff-9bac7e04e4bc-kube-api-access-pjfdm\") pod \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") "
Aug 04 12:13:30.789378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789192    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-dshm\") pod \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") "
Aug 04 12:13:30.789378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789261    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-model-cache\") pod \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") "
Aug 04 12:13:30.789378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tls-certs\") pod \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\" (UID: \"a33e5f59-5732-472b-80ff-9bac7e04e4bc\") "
Aug 04 12:13:30.789656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789483    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-home" (OuterVolumeSpecName: "home") pod "a33e5f59-5732-472b-80ff-9bac7e04e4bc" (UID: "a33e5f59-5732-472b-80ff-9bac7e04e4bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:13:30.789656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789489    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a33e5f59-5732-472b-80ff-9bac7e04e4bc" (UID: "a33e5f59-5732-472b-80ff-9bac7e04e4bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:13:30.789656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.789576    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "a33e5f59-5732-472b-80ff-9bac7e04e4bc" (UID: "a33e5f59-5732-472b-80ff-9bac7e04e4bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:13:30.791471 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.791440    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a33e5f59-5732-472b-80ff-9bac7e04e4bc-kube-api-access-pjfdm" (OuterVolumeSpecName: "kube-api-access-pjfdm") pod "a33e5f59-5732-472b-80ff-9bac7e04e4bc" (UID: "a33e5f59-5732-472b-80ff-9bac7e04e4bc"). InnerVolumeSpecName "kube-api-access-pjfdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:13:30.791572 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.791476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a33e5f59-5732-472b-80ff-9bac7e04e4bc" (UID: "a33e5f59-5732-472b-80ff-9bac7e04e4bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:13:30.791572 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.791519    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-dshm" (OuterVolumeSpecName: "dshm") pod "a33e5f59-5732-472b-80ff-9bac7e04e4bc" (UID: "a33e5f59-5732-472b-80ff-9bac7e04e4bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:13:30.890806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.890772    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-model-cache\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:13:30.890806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.890800    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tls-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:13:30.890806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.890808    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-home\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:13:30.890806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.890815    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-tmp-dir\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:13:30.891083 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.890825    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjfdm\" (UniqueName: \"kubernetes.io/projected/a33e5f59-5732-472b-80ff-9bac7e04e4bc-kube-api-access-pjfdm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:13:30.891083 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:30.890833    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a33e5f59-5732-472b-80ff-9bac7e04e4bc-dshm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:13:31.038340 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:31.038306    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"]
Aug 04 12:13:31.052582 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:31.052559    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f3708437/e2e-lifecycle-model-f3708437-kserve-5665fb6cf-z7kn6"]
Aug 04 12:13:32.349734 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:32.349705    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a33e5f59-5732-472b-80ff-9bac7e04e4bc" path="/var/lib/kubelet/pods/a33e5f59-5732-472b-80ff-9bac7e04e4bc/volumes"
Aug 04 12:13:58.590670 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:58.590582    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"]
Aug 04 12:13:58.591181 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:13:58.590824    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" containerID="cri-o://42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba" gracePeriod=30
Aug 04 12:14:00.507615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:00.507574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:14:02.117645 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:02.117607    2582 patch_prober.go:28] interesting pod/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:14:02.118043 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:02.117676    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:14:03.835509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.835476    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:14:03.884317 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.884224    2582 generic.go:356] "Generic (PLEG): container finished" podID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerID="42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba" exitCode=0
Aug 04 12:14:03.884317 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.884282    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"
Aug 04 12:14:03.884317 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.884305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" event={"ID":"f64662a8-c909-442a-b1bd-667aab0ab56c","Type":"ContainerDied","Data":"42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba"}
Aug 04 12:14:03.884615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.884366    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8" event={"ID":"f64662a8-c909-442a-b1bd-667aab0ab56c","Type":"ContainerDied","Data":"33c656103f680fdd8f51f8507ad41bd861198ec820d6d460ee1963e07a29b15f"}
Aug 04 12:14:03.884615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.884397    2582 scope.go:117] "RemoveContainer" containerID="42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba"
Aug 04 12:14:03.893828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.893807    2582 scope.go:117] "RemoveContainer" containerID="0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901686    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-podinfo\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901730    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-data\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-certs\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901818    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-token\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901839    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtmsp\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-kube-api-access-gtmsp\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901906    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-envoy\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.901982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64662a8-c909-442a-b1bd-667aab0ab56c-istiod-ca-cert\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.902032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-credential-socket\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.902970 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.902057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-socket\") pod \"f64662a8-c909-442a-b1bd-667aab0ab56c\" (UID: \"f64662a8-c909-442a-b1bd-667aab0ab56c\") "
Aug 04 12:14:03.904041 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.903595    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:14:03.904041 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.903739    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:14:03.904041 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.903980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:14:03.904265 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.904129    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64662a8-c909-442a-b1bd-667aab0ab56c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:14:03.904800 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.904775    2582 scope.go:117] "RemoveContainer" containerID="42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba"
Aug 04 12:14:03.907072 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:14:03.905489    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba\": container with ID starting with 42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba not found: ID does not exist" containerID="42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba"
Aug 04 12:14:03.907072 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.905527    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba"} err="failed to get container status \"42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba\": rpc error: code = NotFound desc = could not find container \"42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba\": container with ID starting with 42abd672b8b6da3d0c19e1b449fac4fc5611e766b02542fc48d101819f9355ba not found: ID does not exist"
Aug 04 12:14:03.907072 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.905554    2582 scope.go:117] "RemoveContainer" containerID="0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"
Aug 04 12:14:03.907072 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.905569    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:14:03.907544 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.907521    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-kube-api-access-gtmsp" (OuterVolumeSpecName: "kube-api-access-gtmsp") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "kube-api-access-gtmsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:14:03.909437 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:14:03.908086    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3\": container with ID starting with 0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3 not found: ID does not exist" containerID="0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"
Aug 04 12:14:03.909437 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.908124    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3"} err="failed to get container status \"0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3\": rpc error: code = NotFound desc = could not find container \"0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3\": container with ID starting with 0b99c21a68b2d30b14fa16aca3deacd002221c0baf3eb239a28f23b18c1435d3 not found: ID does not exist"
Aug 04 12:14:03.913442 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.913393    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:14:03.913548 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.913422    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:14:03.914547 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:03.914518    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f64662a8-c909-442a-b1bd-667aab0ab56c" (UID: "f64662a8-c909-442a-b1bd-667aab0ab56c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:14:04.004419 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004368    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004419 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004397    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64662a8-c909-442a-b1bd-667aab0ab56c-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004419 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004425    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004434    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004443    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004450    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004458    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64662a8-c909-442a-b1bd-667aab0ab56c-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004465    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.004674 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.004496    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtmsp\" (UniqueName: \"kubernetes.io/projected/f64662a8-c909-442a-b1bd-667aab0ab56c-kube-api-access-gtmsp\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:14:04.207306 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.207276    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"]
Aug 04 12:14:04.210863 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.210836    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f3708437-openshift-default-548f994dbd-74zs8"]
Aug 04 12:14:04.351342 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:04.351305    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" path="/var/lib/kubelet/pods/f64662a8-c909-442a-b1bd-667aab0ab56c/volumes"
Aug 04 12:14:12.694312 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:12.694275    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:14:18.714803 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:18.714759    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:14:25.898176 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:14:25.898134    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:15:00.146607 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.146562    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"]
Aug 04 12:15:00.147230 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147147    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy"
Aug 04 12:15:00.147230 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147168    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy"
Aug 04 12:15:00.147230 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147196    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy"
Aug 04 12:15:00.147230 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147205    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy"
Aug 04 12:15:00.147230 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147230    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33e5f59-5732-472b-80ff-9bac7e04e4bc" containerName="main"
Aug 04 12:15:00.147538 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147238    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33e5f59-5732-472b-80ff-9bac7e04e4bc" containerName="main"
Aug 04 12:15:00.147538 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147322    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy"
Aug 04 12:15:00.147538 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.147336    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a33e5f59-5732-472b-80ff-9bac7e04e4bc" containerName="main"
Aug 04 12:15:00.150565 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.150541    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"
Aug 04 12:15:00.152946 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.152916    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pv6cr\""
Aug 04 12:15:00.157874 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.157846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"]
Aug 04 12:15:00.162316 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.162294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"
Aug 04 12:15:00.306943 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.306915    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"]
Aug 04 12:15:00.309995 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:15:00.309965    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a2e758_b752_46a7_bc44_f7cbb9be502d.slice/crio-5bdb97bf090c9ef34b24f4fc5b4d77de68e8b29cb95218fbcc84236e58c0142c WatchSource:0}: Error finding container 5bdb97bf090c9ef34b24f4fc5b4d77de68e8b29cb95218fbcc84236e58c0142c: Status 404 returned error can't find the container with id 5bdb97bf090c9ef34b24f4fc5b4d77de68e8b29cb95218fbcc84236e58c0142c
Aug 04 12:15:00.312443 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:00.312425    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 12:15:01.193814 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:01.193770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk" event={"ID":"29a2e758-b752-46a7-bc44-f7cbb9be502d","Type":"ContainerStarted","Data":"5bdb97bf090c9ef34b24f4fc5b4d77de68e8b29cb95218fbcc84236e58c0142c"}
Aug 04 12:15:03.210748 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:03.210707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk" event={"ID":"29a2e758-b752-46a7-bc44-f7cbb9be502d","Type":"ContainerStarted","Data":"bbf56350905bfd69852a0e0872c80ec8f79219d9c316743714140b220a85ab21"}
Aug 04 12:15:03.227566 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:03.227509    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk" podStartSLOduration=1.145869672 podStartE2EDuration="3.227489004s" totalImagesPullingTime="2.081619332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:15:03.226022691 +0000 UTC m=+2511.400508694" watchObservedRunningTime="2026-08-04 12:15:03.227489004 +0000 UTC m=+2511.401975002"
Aug 04 12:15:04.218627 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.218547    2582 generic.go:356] "Generic (PLEG): container finished" podID="29a2e758-b752-46a7-bc44-f7cbb9be502d" containerID="bbf56350905bfd69852a0e0872c80ec8f79219d9c316743714140b220a85ab21" exitCode=0
Aug 04 12:15:04.218627 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.218602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk" event={"ID":"29a2e758-b752-46a7-bc44-f7cbb9be502d","Type":"ContainerDied","Data":"bbf56350905bfd69852a0e0872c80ec8f79219d9c316743714140b220a85ab21"}
Aug 04 12:15:04.935024 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.934986    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"]
Aug 04 12:15:04.935882 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.935855    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64662a8-c909-442a-b1bd-667aab0ab56c" containerName="istio-proxy"
Aug 04 12:15:04.939344 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.939325    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:04.941632 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.941601    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-55901c-openshift-default-dockercfg-qtngc\""
Aug 04 12:15:04.952786 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:04.952753    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"]
Aug 04 12:15:05.070934 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.070892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-certs\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.070934 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.070931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-envoy\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.070958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-credential-socket\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.071033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-token\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.071057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-podinfo\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.071073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5s54\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-kube-api-access-l5s54\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.071090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66d414ee-fae4-47ae-be1d-fb598dca238a-istiod-ca-cert\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071318 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.071174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-data\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.071318 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.071224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-socket\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172401 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-data\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172647 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-socket\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172647 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-certs\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172647 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-envoy\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172647 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-credential-socket\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172647 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-token\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-podinfo\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5s54\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-kube-api-access-l5s54\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66d414ee-fae4-47ae-be1d-fb598dca238a-istiod-ca-cert\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-data\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.172922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-socket\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.173188 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.172976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-certs\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.173398 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.173374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-credential-socket\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.173398 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.173380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66d414ee-fae4-47ae-be1d-fb598dca238a-istiod-ca-cert\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.174834 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.174817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-envoy\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.175149 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.175130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-podinfo\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.187008 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.186935    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-token\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.187152 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.187070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5s54\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-kube-api-access-l5s54\") pod \"e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") " pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.250518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.250475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:05.361799 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.361767    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"
Aug 04 12:15:05.415023 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.414988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"]
Aug 04 12:15:05.415882 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:15:05.415853    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d414ee_fae4_47ae_be1d_fb598dca238a.slice/crio-39ec2ed40a0bf7db817815448e2b5f0fa59841b79829e00151f5f72174672eb1 WatchSource:0}: Error finding container 39ec2ed40a0bf7db817815448e2b5f0fa59841b79829e00151f5f72174672eb1: Status 404 returned error can't find the container with id 39ec2ed40a0bf7db817815448e2b5f0fa59841b79829e00151f5f72174672eb1
Aug 04 12:15:05.418161 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.418122    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:05.418254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.418196    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:05.418254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:05.418233    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:06.231829 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.231800    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk"
Aug 04 12:15:06.232033 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.231799    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764095-jjpgk" event={"ID":"29a2e758-b752-46a7-bc44-f7cbb9be502d","Type":"ContainerDied","Data":"5bdb97bf090c9ef34b24f4fc5b4d77de68e8b29cb95218fbcc84236e58c0142c"}
Aug 04 12:15:06.232033 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.231950    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bdb97bf090c9ef34b24f4fc5b4d77de68e8b29cb95218fbcc84236e58c0142c"
Aug 04 12:15:06.233611 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.233581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" event={"ID":"66d414ee-fae4-47ae-be1d-fb598dca238a","Type":"ContainerStarted","Data":"5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"}
Aug 04 12:15:06.233773 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.233634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" event={"ID":"66d414ee-fae4-47ae-be1d-fb598dca238a","Type":"ContainerStarted","Data":"39ec2ed40a0bf7db817815448e2b5f0fa59841b79829e00151f5f72174672eb1"}
Aug 04 12:15:06.251173 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.251139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:06.253481 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.253432    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podStartSLOduration=2.253398869 podStartE2EDuration="2.253398869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:15:06.251852365 +0000 UTC m=+2514.426338367" watchObservedRunningTime="2026-08-04 12:15:06.253398869 +0000 UTC m=+2514.427884871"
Aug 04 12:15:06.256237 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:06.256212    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:07.239860 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:07.239821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:07.240838 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:07.240814    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:11.702246 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:11.702203    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:15:22.241762 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.241725    2582 patch_prober.go:28] interesting pod/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 12:15:22.242207 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.241779    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 12:15:22.338551 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.338513    2582 generic.go:356] "Generic (PLEG): container finished" podID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerID="5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9" exitCode=0
Aug 04 12:15:22.338745 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.338584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" event={"ID":"66d414ee-fae4-47ae-be1d-fb598dca238a","Type":"ContainerDied","Data":"5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"}
Aug 04 12:15:22.339031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.338999    2582 scope.go:117] "RemoveContainer" containerID="5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"
Aug 04 12:15:22.340006 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.339978    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:22.340062 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.340048    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:22.340098 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:22.340083    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:23.351655 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:23.351605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" event={"ID":"66d414ee-fae4-47ae-be1d-fb598dca238a","Type":"ContainerStarted","Data":"b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2"}
Aug 04 12:15:24.251179 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:24.251138    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:24.251639 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:24.251538    2582 patch_prober.go:28] interesting pod/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 12:15:24.251835 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:24.251811    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 12:15:25.251596 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:25.251552    2582 patch_prober.go:28] interesting pod/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 12:15:25.252288 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:25.252250    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 12:15:26.252020 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:26.251970    2582 patch_prober.go:28] interesting pod/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 12:15:26.252575 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:26.252052    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 12:15:27.251651 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:27.251608    2582 patch_prober.go:28] interesting pod/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 12:15:27.251998 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:27.251963    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 12:15:28.250947 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:28.250904    2582 patch_prober.go:28] interesting pod/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Aug 04 12:15:28.251614 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:28.251576    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Aug 04 12:15:29.254940 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:29.254906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:29.255324 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:29.255267    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:29.256038 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:29.256013    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:15:33.868518 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.868477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"]
Aug 04 12:15:33.869230 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.869208    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a2e758-b752-46a7-bc44-f7cbb9be502d" containerName="cleanup"
Aug 04 12:15:33.869276 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.869235    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a2e758-b752-46a7-bc44-f7cbb9be502d" containerName="cleanup"
Aug 04 12:15:33.869378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.869364    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a2e758-b752-46a7-bc44-f7cbb9be502d" containerName="cleanup"
Aug 04 12:15:33.877482 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.877457    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.879772 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.879751    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-31323b-openshift-default-dockercfg-fpn9w\""
Aug 04 12:15:33.885996 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.885964    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"]
Aug 04 12:15:33.956351 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-socket\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956351 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-token\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-envoy\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-podinfo\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956644 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-certs\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istiod-ca-cert\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-data\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5l2k\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-kube-api-access-d5l2k\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:33.956809 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:33.956754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-credential-socket\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.057923 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.057879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-certs\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058171 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.057949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istiod-ca-cert\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058171 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.057998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-data\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058171 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5l2k\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-kube-api-access-d5l2k\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058171 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-credential-socket\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058171 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-socket\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058171 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-token\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-envoy\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-podinfo\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-data\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-certs\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.058717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.058520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-credential-socket\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.059091 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.059064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istiod-ca-cert\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.059091 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.059077    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-socket\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.060874 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.060852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-envoy\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.061101 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.061081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-podinfo\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.065513 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.065494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-token\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.065682 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.065660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5l2k\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-kube-api-access-d5l2k\") pod \"e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") " pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.191262 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.191170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:34.339315 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.339280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"]
Aug 04 12:15:34.341212 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:15:34.341181    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa34ba9_076b_4bc2_ba9e_c6ffc18e2b53.slice/crio-51802ddf3b842d1a1810a4255ac225fb85625a01f54727884645e0113695f7ba WatchSource:0}: Error finding container 51802ddf3b842d1a1810a4255ac225fb85625a01f54727884645e0113695f7ba: Status 404 returned error can't find the container with id 51802ddf3b842d1a1810a4255ac225fb85625a01f54727884645e0113695f7ba
Aug 04 12:15:34.344001 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.343968    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:34.344092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.344035    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:34.344092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.344063    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:34.430589 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.430553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" event={"ID":"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53","Type":"ContainerStarted","Data":"b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"}
Aug 04 12:15:34.430786 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.430607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" event={"ID":"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53","Type":"ContainerStarted","Data":"51802ddf3b842d1a1810a4255ac225fb85625a01f54727884645e0113695f7ba"}
Aug 04 12:15:34.452661 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:34.452557    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podStartSLOduration=1.452541294 podStartE2EDuration="1.452541294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:15:34.450456872 +0000 UTC m=+2542.624942871" watchObservedRunningTime="2026-08-04 12:15:34.452541294 +0000 UTC m=+2542.627027296"
Aug 04 12:15:35.192247 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:35.192206    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:35.197330 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:35.197303    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:35.436370 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:35.436340    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:35.437462 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:35.437435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:40.392026 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:40.391982    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:15:50.438354 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.438306    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 12:15:50.438907 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.438396    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 12:15:50.533163 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.533129    2582 generic.go:356] "Generic (PLEG): container finished" podID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerID="b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284" exitCode=0
Aug 04 12:15:50.533341 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.533196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" event={"ID":"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53","Type":"ContainerDied","Data":"b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"}
Aug 04 12:15:50.533643 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.533628    2582 scope.go:117] "RemoveContainer" containerID="b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"
Aug 04 12:15:50.534643 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.534615    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:50.534715 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.534679    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:50.534715 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:50.534708    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:15:51.543630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:51.542811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" event={"ID":"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53","Type":"ContainerStarted","Data":"26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e"}
Aug 04 12:15:52.192122 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:52.192077    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:52.192420 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:52.192376    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 12:15:52.192525 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:52.192447    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 12:15:53.192507 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:53.192472    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 12:15:53.192930 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:53.192528    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 12:15:54.192681 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:54.192644    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 12:15:54.193098 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:54.192702    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 12:15:55.192173 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:55.192132    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 12:15:55.192371 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:55.192192    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 12:15:56.191985 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:56.191941    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 04 12:15:56.192370 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:56.192003    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 04 12:15:57.196445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:57.196401    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:57.196859 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:57.196796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:15:57.197552 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:15:57.197530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:16:07.098043 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:07.098002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:16:14.402866 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:14.402825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:16:22.697491 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.697456    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"]
Aug 04 12:16:22.699840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.699822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.701935 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.701912    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-31323b\"/\"default-dockercfg-bwnzd\""
Aug 04 12:16:22.702680 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.702664    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-31323b\"/\"kube-root-ca.crt\""
Aug 04 12:16:22.702754 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.702689    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-31323b\"/\"test-model-31323b-kserve-self-signed-certs\""
Aug 04 12:16:22.703037 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.703022    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-31323b\"/\"openshift-service-ca.crt\""
Aug 04 12:16:22.712871 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.712845    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"]
Aug 04 12:16:22.833631 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.833591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ce6b59-1239-442f-b694-a4dba68678d5-tls-certs\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.833631 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.833631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-home\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.833880 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.833658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-tmp-dir\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.833880 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.833712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-model-cache\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.833880 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.833729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-dshm\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.833880 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.833845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6z8c\" (UniqueName: \"kubernetes.io/projected/80ce6b59-1239-442f-b694-a4dba68678d5-kube-api-access-g6z8c\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.934840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.934785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6z8c\" (UniqueName: \"kubernetes.io/projected/80ce6b59-1239-442f-b694-a4dba68678d5-kube-api-access-g6z8c\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.934840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.934854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ce6b59-1239-442f-b694-a4dba68678d5-tls-certs\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.934876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-home\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.934902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-tmp-dir\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.934932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-model-cache\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.934956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-dshm\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935383 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.935359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-home\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935481 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.935455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-tmp-dir\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.935548 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.935475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-model-cache\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.937394 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.937365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-dshm\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.937804 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.937783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ce6b59-1239-442f-b694-a4dba68678d5-tls-certs\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:22.942967 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:22.942944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6z8c\" (UniqueName: \"kubernetes.io/projected/80ce6b59-1239-442f-b694-a4dba68678d5-kube-api-access-g6z8c\") pod \"test-model-31323b-kserve-69c5cdcc65-lmnh7\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") " pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:23.009501 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:23.009389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:23.150333 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:23.150294    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"]
Aug 04 12:16:23.153872 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:16:23.153827    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80ce6b59_1239_442f_b694_a4dba68678d5.slice/crio-4eb32d99637b203db10aedc70ad0d4884faac71dfb14aa09b2c30285d52192a7 WatchSource:0}: Error finding container 4eb32d99637b203db10aedc70ad0d4884faac71dfb14aa09b2c30285d52192a7: Status 404 returned error can't find the container with id 4eb32d99637b203db10aedc70ad0d4884faac71dfb14aa09b2c30285d52192a7
Aug 04 12:16:23.730351 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:23.730309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7" event={"ID":"80ce6b59-1239-442f-b694-a4dba68678d5","Type":"ContainerStarted","Data":"fe7fffaec5c47e7227efbed565068051aaf3ccdd2cfed1b269c3e3baff32e68c"}
Aug 04 12:16:23.730792 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:23.730359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7" event={"ID":"80ce6b59-1239-442f-b694-a4dba68678d5","Type":"ContainerStarted","Data":"4eb32d99637b203db10aedc70ad0d4884faac71dfb14aa09b2c30285d52192a7"}
Aug 04 12:16:23.766021 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:23.765961    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7" podStartSLOduration=1.765944604 podStartE2EDuration="1.765944604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:16:23.764283478 +0000 UTC m=+2591.938769481" watchObservedRunningTime="2026-08-04 12:16:23.765944604 +0000 UTC m=+2591.940430607"
Aug 04 12:16:25.425625 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:25.425589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:16:33.010269 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:33.010232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:33.010746 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:33.010310    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:33.023380 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:33.023348    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:16:33.796182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:16:33.796150    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:17:01.783605 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:01.781973    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"]
Aug 04 12:17:05.819532 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:05.819488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:17:14.701043 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:14.701004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:17:16.805526 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:16.805484    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7" podUID="80ce6b59-1239-442f-b694-a4dba68678d5" containerName="main" containerID="cri-o://fe7fffaec5c47e7227efbed565068051aaf3ccdd2cfed1b269c3e3baff32e68c" gracePeriod=45
Aug 04 12:17:17.033927 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.033892    2582 generic.go:356] "Generic (PLEG): container finished" podID="80ce6b59-1239-442f-b694-a4dba68678d5" containerID="fe7fffaec5c47e7227efbed565068051aaf3ccdd2cfed1b269c3e3baff32e68c" exitCode=0
Aug 04 12:17:17.034118 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.033970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7" event={"ID":"80ce6b59-1239-442f-b694-a4dba68678d5","Type":"ContainerDied","Data":"fe7fffaec5c47e7227efbed565068051aaf3ccdd2cfed1b269c3e3baff32e68c"}
Aug 04 12:17:17.061510 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.061433    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:17:17.165807 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.165766    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-dshm\") pod \"80ce6b59-1239-442f-b694-a4dba68678d5\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") "
Aug 04 12:17:17.165807 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.165819    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-model-cache\") pod \"80ce6b59-1239-442f-b694-a4dba68678d5\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") "
Aug 04 12:17:17.166101 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.165849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-home\") pod \"80ce6b59-1239-442f-b694-a4dba68678d5\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") "
Aug 04 12:17:17.166101 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.165896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ce6b59-1239-442f-b694-a4dba68678d5-tls-certs\") pod \"80ce6b59-1239-442f-b694-a4dba68678d5\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") "
Aug 04 12:17:17.166101 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.165930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6z8c\" (UniqueName: \"kubernetes.io/projected/80ce6b59-1239-442f-b694-a4dba68678d5-kube-api-access-g6z8c\") pod \"80ce6b59-1239-442f-b694-a4dba68678d5\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") "
Aug 04 12:17:17.166267 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166143    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-tmp-dir\") pod \"80ce6b59-1239-442f-b694-a4dba68678d5\" (UID: \"80ce6b59-1239-442f-b694-a4dba68678d5\") "
Aug 04 12:17:17.166267 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "80ce6b59-1239-442f-b694-a4dba68678d5" (UID: "80ce6b59-1239-442f-b694-a4dba68678d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:17.166394 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166259    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-home" (OuterVolumeSpecName: "home") pod "80ce6b59-1239-442f-b694-a4dba68678d5" (UID: "80ce6b59-1239-442f-b694-a4dba68678d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:17.166394 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166381    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "80ce6b59-1239-442f-b694-a4dba68678d5" (UID: "80ce6b59-1239-442f-b694-a4dba68678d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:17.166549 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166504    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-tmp-dir\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:17.166549 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166519    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-model-cache\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:17.166549 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.166529    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-home\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:17.168175 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.168155    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-dshm" (OuterVolumeSpecName: "dshm") pod "80ce6b59-1239-442f-b694-a4dba68678d5" (UID: "80ce6b59-1239-442f-b694-a4dba68678d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:17.168285 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.168191    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80ce6b59-1239-442f-b694-a4dba68678d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "80ce6b59-1239-442f-b694-a4dba68678d5" (UID: "80ce6b59-1239-442f-b694-a4dba68678d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:17:17.168285 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.168275    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ce6b59-1239-442f-b694-a4dba68678d5-kube-api-access-g6z8c" (OuterVolumeSpecName: "kube-api-access-g6z8c") pod "80ce6b59-1239-442f-b694-a4dba68678d5" (UID: "80ce6b59-1239-442f-b694-a4dba68678d5"). InnerVolumeSpecName "kube-api-access-g6z8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:17:17.267010 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.266971    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ce6b59-1239-442f-b694-a4dba68678d5-dshm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:17.267010 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.267004    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ce6b59-1239-442f-b694-a4dba68678d5-tls-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:17.267010 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:17.267014    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6z8c\" (UniqueName: \"kubernetes.io/projected/80ce6b59-1239-442f-b694-a4dba68678d5-kube-api-access-g6z8c\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:18.043823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:18.043791    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"
Aug 04 12:17:18.043823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:18.043802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7" event={"ID":"80ce6b59-1239-442f-b694-a4dba68678d5","Type":"ContainerDied","Data":"4eb32d99637b203db10aedc70ad0d4884faac71dfb14aa09b2c30285d52192a7"}
Aug 04 12:17:18.044359 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:18.043859    2582 scope.go:117] "RemoveContainer" containerID="fe7fffaec5c47e7227efbed565068051aaf3ccdd2cfed1b269c3e3baff32e68c"
Aug 04 12:17:18.070427 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:18.070378    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"]
Aug 04 12:17:18.080295 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:18.080257    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-31323b/test-model-31323b-kserve-69c5cdcc65-lmnh7"]
Aug 04 12:17:18.350184 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:18.350153    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ce6b59-1239-442f-b694-a4dba68678d5" path="/var/lib/kubelet/pods/80ce6b59-1239-442f-b694-a4dba68678d5/volumes"
Aug 04 12:17:20.194817 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:20.194781    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"]
Aug 04 12:17:20.195245 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:20.195001    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy" containerID="cri-o://b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2" gracePeriod=30
Aug 04 12:17:25.453913 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.453887    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:17:25.543385 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543291    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-token\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543385 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543336    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5s54\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-kube-api-access-l5s54\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543385 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543361    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-envoy\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543457    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-podinfo\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543494    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-credential-socket\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543517    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-certs\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543566    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-socket\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543616    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66d414ee-fae4-47ae-be1d-fb598dca238a-istiod-ca-cert\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543654    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-data\") pod \"66d414ee-fae4-47ae-be1d-fb598dca238a\" (UID: \"66d414ee-fae4-47ae-be1d-fb598dca238a\") "
Aug 04 12:17:25.543964 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:25.543964 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.543928    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:25.544071 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.544050    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:25.544195 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.544173    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-data" (OuterVolumeSpecName: "istio-data") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:25.544272 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.544252    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d414ee-fae4-47ae-be1d-fb598dca238a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:17:25.545770 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.545749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:25.545898 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.545793    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-kube-api-access-l5s54" (OuterVolumeSpecName: "kube-api-access-l5s54") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "kube-api-access-l5s54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:17:25.546055 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.546034    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:17:25.546112 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.546072    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-token" (OuterVolumeSpecName: "istio-token") pod "66d414ee-fae4-47ae-be1d-fb598dca238a" (UID: "66d414ee-fae4-47ae-be1d-fb598dca238a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:17:25.645128 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645087    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645128 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645118    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645128 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645129    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645128 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645138    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645397 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645148    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66d414ee-fae4-47ae-be1d-fb598dca238a-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645397 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645155    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645397 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645164    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645397 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645171    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5s54\" (UniqueName: \"kubernetes.io/projected/66d414ee-fae4-47ae-be1d-fb598dca238a-kube-api-access-l5s54\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:25.645397 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:25.645180    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66d414ee-fae4-47ae-be1d-fb598dca238a-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:26.089363 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.089327    2582 generic.go:356] "Generic (PLEG): container finished" podID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerID="b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2" exitCode=0
Aug 04 12:17:26.089583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.089389    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"
Aug 04 12:17:26.089583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.089432    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" event={"ID":"66d414ee-fae4-47ae-be1d-fb598dca238a","Type":"ContainerDied","Data":"b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2"}
Aug 04 12:17:26.089583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.089524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6" event={"ID":"66d414ee-fae4-47ae-be1d-fb598dca238a","Type":"ContainerDied","Data":"39ec2ed40a0bf7db817815448e2b5f0fa59841b79829e00151f5f72174672eb1"}
Aug 04 12:17:26.089583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.089550    2582 scope.go:117] "RemoveContainer" containerID="b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2"
Aug 04 12:17:26.099363 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.099344    2582 scope.go:117] "RemoveContainer" containerID="5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"
Aug 04 12:17:26.108279 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.108257    2582 scope.go:117] "RemoveContainer" containerID="b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2"
Aug 04 12:17:26.108590 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:17:26.108569    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2\": container with ID starting with b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2 not found: ID does not exist" containerID="b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2"
Aug 04 12:17:26.108667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.108604    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2"} err="failed to get container status \"b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2\": rpc error: code = NotFound desc = could not find container \"b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2\": container with ID starting with b2de66a008dbdd939a2c76ce52542c071289f52a18beb1f8ca75e5e0199b3ec2 not found: ID does not exist"
Aug 04 12:17:26.108667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.108629    2582 scope.go:117] "RemoveContainer" containerID="5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"
Aug 04 12:17:26.108900 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:17:26.108880    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9\": container with ID starting with 5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9 not found: ID does not exist" containerID="5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"
Aug 04 12:17:26.108948 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.108907    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9"} err="failed to get container status \"5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9\": rpc error: code = NotFound desc = could not find container \"5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9\": container with ID starting with 5d9313b5e1dae292761d2ad6ca6bff3ae7c19345a8c9c32aa698ea90aee00cf9 not found: ID does not exist"
Aug 04 12:17:26.117554 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.117530    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"]
Aug 04 12:17:26.126826 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.126803    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-55901c-openshift-default-5466b565dd-gxbl6"]
Aug 04 12:17:26.351188 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:26.351156    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" path="/var/lib/kubelet/pods/66d414ee-fae4-47ae-be1d-fb598dca238a/volumes"
Aug 04 12:17:33.118086 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:33.118048    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:17:39.634241 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:39.634206    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"]
Aug 04 12:17:39.634697 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:39.634455    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" containerID="cri-o://26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e" gracePeriod=30
Aug 04 12:17:40.734117 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734081    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"]
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734511    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734527    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734537    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734542    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734551    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ce6b59-1239-442f-b694-a4dba68678d5" containerName="main"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734556    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ce6b59-1239-442f-b694-a4dba68678d5" containerName="main"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734619    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ce6b59-1239-442f-b694-a4dba68678d5" containerName="main"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734627    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy"
Aug 04 12:17:40.734630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.734637    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d414ee-fae4-47ae-be1d-fb598dca238a" containerName="istio-proxy"
Aug 04 12:17:40.737840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.737819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.740990 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.740964    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-62afff-openshift-default-dockercfg-h67gk\""
Aug 04 12:17:40.772986 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.772947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"]
Aug 04 12:17:40.890329 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-socket\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890329 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-data\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-envoy\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p9d\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-kube-api-access-75p9d\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-credential-socket\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890693 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-token\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890693 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-certs\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890693 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-podinfo\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.890790 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.890707    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istiod-ca-cert\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991245 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-credential-socket\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991245 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-token\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-certs\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-podinfo\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istiod-ca-cert\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-socket\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-data\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991519 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-envoy\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991837 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75p9d\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-kube-api-access-75p9d\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991837 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-credential-socket\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991837 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991685    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-certs\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.991837 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991735    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-socket\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.992032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.991989    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-data\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.992124 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.992104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istiod-ca-cert\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.993789 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.993763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-envoy\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:40.993933 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:40.993900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-podinfo\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:41.005191 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.005163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-token\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:41.005388 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.005365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p9d\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-kube-api-access-75p9d\") pod \"e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") " pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:41.048879 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.048845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:41.206573 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.206548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"]
Aug 04 12:17:41.208324 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:17:41.208296    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf262ed76_6e00_44c3_93a0_bc0b4bbe0c88.slice/crio-d3ff95b2c33caa378de77f619d5172463ea2e65c4924500968db767d5765a190 WatchSource:0}: Error finding container d3ff95b2c33caa378de77f619d5172463ea2e65c4924500968db767d5765a190: Status 404 returned error can't find the container with id d3ff95b2c33caa378de77f619d5172463ea2e65c4924500968db767d5765a190
Aug 04 12:17:41.210450 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.210396    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:17:41.210545 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.210486    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:17:41.210545 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:41.210514    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:17:42.183849 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:42.183813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" event={"ID":"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88","Type":"ContainerStarted","Data":"6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"}
Aug 04 12:17:42.184263 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:42.183867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" event={"ID":"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88","Type":"ContainerStarted","Data":"d3ff95b2c33caa378de77f619d5172463ea2e65c4924500968db767d5765a190"}
Aug 04 12:17:42.199353 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:42.199317    2582 patch_prober.go:28] interesting pod/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:17:42.199514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:42.199383    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:17:42.226625 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:42.226564    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podStartSLOduration=2.226546636 podStartE2EDuration="2.226546636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:17:42.223227968 +0000 UTC m=+2670.397713969" watchObservedRunningTime="2026-08-04 12:17:42.226546636 +0000 UTC m=+2670.401032638"
Aug 04 12:17:43.049391 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:43.049351    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:43.054579 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:43.054551    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:43.189396 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:43.189359    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:43.190538 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:43.190511    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:17:44.889851 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:44.889825    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:17:45.032132 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032046    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-data\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032132 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-token\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032132 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istiod-ca-cert\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032202    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-socket\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032236    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5l2k\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-kube-api-access-d5l2k\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032289    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-envoy\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032349    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-podinfo\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032362    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:45.032642 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032388    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-credential-socket\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032642 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032469    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-certs\") pod \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\" (UID: \"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53\") "
Aug 04 12:17:45.032749 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032639    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:45.032749 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032681    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:17:45.032859 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032821    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:45.032954 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032935    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.032999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032948    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:45.032999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032960    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.032999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032975    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.032999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.032989    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.034533 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.034509    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:17:45.034622 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.034597    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:17:45.034894 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.034868    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:17:45.034968 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.034893    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-kube-api-access-d5l2k" (OuterVolumeSpecName: "kube-api-access-d5l2k") pod "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" (UID: "8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53"). InnerVolumeSpecName "kube-api-access-d5l2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:17:45.133548 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.133510    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.133548 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.133542    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.133548 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.133551    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.133790 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.133559    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.133790 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.133568    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5l2k\" (UniqueName: \"kubernetes.io/projected/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53-kube-api-access-d5l2k\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:17:45.202823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.202789    2582 generic.go:356] "Generic (PLEG): container finished" podID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerID="26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e" exitCode=0
Aug 04 12:17:45.203020 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.202845    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"
Aug 04 12:17:45.203020 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.202878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" event={"ID":"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53","Type":"ContainerDied","Data":"26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e"}
Aug 04 12:17:45.203020 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.202942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk" event={"ID":"8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53","Type":"ContainerDied","Data":"51802ddf3b842d1a1810a4255ac225fb85625a01f54727884645e0113695f7ba"}
Aug 04 12:17:45.203020 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.202976    2582 scope.go:117] "RemoveContainer" containerID="26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e"
Aug 04 12:17:45.213325 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.213304    2582 scope.go:117] "RemoveContainer" containerID="b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"
Aug 04 12:17:45.222361 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.222336    2582 scope.go:117] "RemoveContainer" containerID="26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e"
Aug 04 12:17:45.222666 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:17:45.222642    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e\": container with ID starting with 26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e not found: ID does not exist" containerID="26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e"
Aug 04 12:17:45.222728 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.222675    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e"} err="failed to get container status \"26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e\": rpc error: code = NotFound desc = could not find container \"26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e\": container with ID starting with 26936f539f4b09cf1b4ca024e5cce460c5f61045f8215b84cba49f017d667f9e not found: ID does not exist"
Aug 04 12:17:45.222728 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.222695    2582 scope.go:117] "RemoveContainer" containerID="b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"
Aug 04 12:17:45.222942 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:17:45.222922    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284\": container with ID starting with b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284 not found: ID does not exist" containerID="b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"
Aug 04 12:17:45.222992 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.222950    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284"} err="failed to get container status \"b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284\": rpc error: code = NotFound desc = could not find container \"b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284\": container with ID starting with b40cfd80309316295a6be9981f59590d7caee5ee4f1da2e8241e1c3cbf223284 not found: ID does not exist"
Aug 04 12:17:45.237807 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.237776    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"]
Aug 04 12:17:45.251206 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:45.251177    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-31323b-openshift-default-868b86bb4-pfjtk"]
Aug 04 12:17:46.350526 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:46.350495    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" path="/var/lib/kubelet/pods/8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53/volumes"
Aug 04 12:17:49.253930 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:49.253887    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:17:59.068626 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.067492    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": read tcp 10.134.0.2:34598->10.134.0.58:15021: read: connection reset by peer" start-of-body=
Aug 04 12:17:59.068626 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.067561    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": read tcp 10.134.0.2:34598->10.134.0.58:15021: read: connection reset by peer"
Aug 04 12:17:59.303459 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.303353    2582 generic.go:356] "Generic (PLEG): container finished" podID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerID="6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf" exitCode=0
Aug 04 12:17:59.303459 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.303427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" event={"ID":"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88","Type":"ContainerDied","Data":"6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"}
Aug 04 12:17:59.303843 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.303829    2582 scope.go:117] "RemoveContainer" containerID="6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"
Aug 04 12:17:59.304884 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.304855    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:17:59.304952 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.304925    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:17:59.304989 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:17:59.304956    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:00.311443 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:00.311385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" event={"ID":"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88","Type":"ContainerStarted","Data":"4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25"}
Aug 04 12:18:01.049910 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:01.049872    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:18:01.050146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:01.050058    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 12:18:01.050146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:01.050127    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 12:18:02.049827 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:02.049784    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 12:18:02.050530 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:02.050488    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 12:18:03.057174 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:03.057127    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 12:18:03.057723 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:03.057198    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 12:18:04.050421 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:04.050358    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 12:18:04.050907 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:04.050869    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 12:18:05.049252 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:05.049210    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 04 12:18:05.050066 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:05.050032    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 04 12:18:06.053247 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:06.053213    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:18:06.053722 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:06.053450    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:18:06.054355 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:06.054338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:18:10.322922 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.322881    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"]
Aug 04 12:18:10.323398 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.323382    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy"
Aug 04 12:18:10.323398 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.323399    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy"
Aug 04 12:18:10.323572 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.323436    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy"
Aug 04 12:18:10.323572 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.323442    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy"
Aug 04 12:18:10.323572 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.323517    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy"
Aug 04 12:18:10.326902 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.326881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.329568 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.329545    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9e17b5-openshift-default-dockercfg-57vcv\""
Aug 04 12:18:10.351954 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.351925    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"]
Aug 04 12:18:10.364607 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.364570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-data\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.364808 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.364723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7pbg\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-kube-api-access-b7pbg\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.364808 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.364802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-credential-socket\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.365090 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.365057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-socket\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.365221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.365114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-podinfo\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.365221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.365145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-certs\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.365221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.365163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-envoy\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.365221 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.365182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-token\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.365438 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.365233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/719224c6-c1f8-4cff-961d-43f9e3bee566-istiod-ca-cert\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466340 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-certs\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466340 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-envoy\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-token\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/719224c6-c1f8-4cff-961d-43f9e3bee566-istiod-ca-cert\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-data\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7pbg\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-kube-api-access-b7pbg\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-credential-socket\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-socket\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.466629 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-podinfo\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.467008 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466801    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-certs\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.467008 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466947    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-credential-socket\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.467008 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.466977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-socket\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.467213 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.467193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-data\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.467274 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.467209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/719224c6-c1f8-4cff-961d-43f9e3bee566-istiod-ca-cert\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.468903 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.468885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-envoy\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.469307 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.469285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-podinfo\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.477028 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.476998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-token\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.478622 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.478599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7pbg\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-kube-api-access-b7pbg\") pod \"e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") " pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.638190 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.638149    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:10.827470 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:18:10.827437    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719224c6_c1f8_4cff_961d_43f9e3bee566.slice/crio-b5821b7d0ce4355771291a5e0bb1f97ac133747821073527a6d02c889ab74fd9 WatchSource:0}: Error finding container b5821b7d0ce4355771291a5e0bb1f97ac133747821073527a6d02c889ab74fd9: Status 404 returned error can't find the container with id b5821b7d0ce4355771291a5e0bb1f97ac133747821073527a6d02c889ab74fd9
Aug 04 12:18:10.827470 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.827449    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"]
Aug 04 12:18:10.829583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.829550    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:10.829664 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.829617    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:10.829664 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:10.829645    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:11.381222 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:11.381183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" event={"ID":"719224c6-c1f8-4cff-961d-43f9e3bee566","Type":"ContainerStarted","Data":"588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"}
Aug 04 12:18:11.381658 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:11.381240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" event={"ID":"719224c6-c1f8-4cff-961d-43f9e3bee566","Type":"ContainerStarted","Data":"b5821b7d0ce4355771291a5e0bb1f97ac133747821073527a6d02c889ab74fd9"}
Aug 04 12:18:11.419583 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:11.419524    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podStartSLOduration=1.419504234 podStartE2EDuration="1.419504234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:18:11.418344768 +0000 UTC m=+2699.592830768" watchObservedRunningTime="2026-08-04 12:18:11.419504234 +0000 UTC m=+2699.593990248"
Aug 04 12:18:11.638897 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:11.638817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:11.644104 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:11.644075    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:12.389555 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:12.389519    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:12.390649 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:12.390619    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:16.921041 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:16.920993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:18:26.473825 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:26.473734    2582 generic.go:356] "Generic (PLEG): container finished" podID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerID="588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab" exitCode=0
Aug 04 12:18:26.473825 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:26.473793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" event={"ID":"719224c6-c1f8-4cff-961d-43f9e3bee566","Type":"ContainerDied","Data":"588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"}
Aug 04 12:18:26.474261 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:26.474190    2582 scope.go:117] "RemoveContainer" containerID="588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"
Aug 04 12:18:26.475324 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:26.475293    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:26.475393 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:26.475364    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:26.475449 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:26.475396    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:18:27.390032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:27.389977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:27.480860 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:27.480825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" event={"ID":"719224c6-c1f8-4cff-961d-43f9e3bee566","Type":"ContainerStarted","Data":"a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029"}
Aug 04 12:18:27.639375 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:27.639326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:27.641074 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:27.640679    2582 patch_prober.go:28] interesting pod/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 12:18:27.641074 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:27.640744    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 12:18:28.651432 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:28.650871    2582 patch_prober.go:28] interesting pod/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 12:18:28.651432 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:28.650961    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 12:18:29.638891 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:29.638845    2582 patch_prober.go:28] interesting pod/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 12:18:29.639219 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:29.639184    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 12:18:30.639344 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:30.639304    2582 patch_prober.go:28] interesting pod/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 12:18:30.640382 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:30.639965    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 12:18:31.639377 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:31.639332    2582 patch_prober.go:28] interesting pod/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Aug 04 12:18:31.639911 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:31.639426    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Aug 04 12:18:32.643131 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:32.643096    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:32.643573 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:32.643376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:18:32.644177 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:18:32.644159    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:19:00.007147 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:00.007103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:19:04.726108 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:04.726073    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"]
Aug 04 12:19:04.726622 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:04.726419    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" containerID="cri-o://4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25" gracePeriod=30
Aug 04 12:19:06.056620 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:06.056581    2582 patch_prober.go:28] interesting pod/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:19:06.057003 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:06.056641    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:19:09.983250 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:09.983224    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:19:10.173509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173470    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-token\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-certs\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173584    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-socket\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75p9d\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-kube-api-access-75p9d\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173627    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-credential-socket\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istiod-ca-cert\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-data\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.173782 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173749    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-podinfo\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.174085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173816    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-envoy\") pod \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\" (UID: \"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88\") "
Aug 04 12:19:10.174085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173892    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:10.174085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.173969    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:10.174085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174052    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:10.174085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-data" (OuterVolumeSpecName: "istio-data") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:10.174311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:19:10.174311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174225    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.174311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174245    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.174311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174259    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.174311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174273    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.174311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.174286    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.176042 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.176015    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:19:10.176139 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.176107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-kube-api-access-75p9d" (OuterVolumeSpecName: "kube-api-access-75p9d") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "kube-api-access-75p9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:19:10.176235 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.176217    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-token" (OuterVolumeSpecName: "istio-token") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:19:10.176295 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.176280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" (UID: "f262ed76-6e00-44c3-93a0-bc0b4bbe0c88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:10.275764 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.275727    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.275764 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.275759    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.275764 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.275769    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75p9d\" (UniqueName: \"kubernetes.io/projected/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-kube-api-access-75p9d\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.276031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.275779    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:10.737154 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.737114    2582 generic.go:356] "Generic (PLEG): container finished" podID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerID="4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25" exitCode=0
Aug 04 12:19:10.737366 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.737168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" event={"ID":"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88","Type":"ContainerDied","Data":"4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25"}
Aug 04 12:19:10.737366 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.737177    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"
Aug 04 12:19:10.737366 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.737257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w" event={"ID":"f262ed76-6e00-44c3-93a0-bc0b4bbe0c88","Type":"ContainerDied","Data":"d3ff95b2c33caa378de77f619d5172463ea2e65c4924500968db767d5765a190"}
Aug 04 12:19:10.737366 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.737288    2582 scope.go:117] "RemoveContainer" containerID="4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25"
Aug 04 12:19:10.746813 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.746789    2582 scope.go:117] "RemoveContainer" containerID="6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"
Aug 04 12:19:10.755735 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.755712    2582 scope.go:117] "RemoveContainer" containerID="4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25"
Aug 04 12:19:10.755983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.755961    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"]
Aug 04 12:19:10.756054 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:19:10.756017    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25\": container with ID starting with 4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25 not found: ID does not exist" containerID="4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25"
Aug 04 12:19:10.756098 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.756045    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25"} err="failed to get container status \"4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25\": rpc error: code = NotFound desc = could not find container \"4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25\": container with ID starting with 4302cd944dc3b8f3b958f0b5e003c48d0bf104abddf08707ff04214f17886c25 not found: ID does not exist"
Aug 04 12:19:10.756098 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.756065    2582 scope.go:117] "RemoveContainer" containerID="6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"
Aug 04 12:19:10.756322 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:19:10.756306    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf\": container with ID starting with 6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf not found: ID does not exist" containerID="6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"
Aug 04 12:19:10.756359 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.756324    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf"} err="failed to get container status \"6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf\": rpc error: code = NotFound desc = could not find container \"6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf\": container with ID starting with 6bf49c96363d20a3565422cac40a8f984efc8645fa89e1afe189ec985ce203bf not found: ID does not exist"
Aug 04 12:19:10.760115 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:10.760089    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-62afff-openshift-default-7cb7dbd894-w7l4w"]
Aug 04 12:19:12.353073 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:12.353036    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" path="/var/lib/kubelet/pods/f262ed76-6e00-44c3-93a0-bc0b4bbe0c88/volumes"
Aug 04 12:19:22.649914 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:22.649870    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:19:28.411948 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:28.411908    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"]
Aug 04 12:19:28.412451 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:28.412121    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" containerID="cri-o://a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029" gracePeriod=30
Aug 04 12:19:29.304643 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.304597    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"]
Aug 04 12:19:29.305106 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.305086    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy"
Aug 04 12:19:29.305106 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.305107    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy"
Aug 04 12:19:29.305259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.305232    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy"
Aug 04 12:19:29.305259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.305250    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy"
Aug 04 12:19:29.305357 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.305263    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa34ba9-076b-4bc2-ba9e-c6ffc18e2b53" containerName="istio-proxy"
Aug 04 12:19:29.308482 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.308456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.310981 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.310951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a7013e-openshift-default-dockercfg-tqz8n\""
Aug 04 12:19:29.322129 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.322098    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"]
Aug 04 12:19:29.358005 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.357964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-podinfo\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358181 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-data\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358181 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358117    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knt8n\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-kube-api-access-knt8n\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358181 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-token\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358335 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-envoy\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358335 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-certs\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358455 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-socket\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358455 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istiod-ca-cert\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.358455 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.358436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-credential-socket\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.459923 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.459870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knt8n\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-kube-api-access-knt8n\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.459940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-token\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.459971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-envoy\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-certs\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-socket\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istiod-ca-cert\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-credential-socket\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-podinfo\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460445 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-data\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460893 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-certs\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460893 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-socket\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460893 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-credential-socket\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.460893 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-data\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.461092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.460955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istiod-ca-cert\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.462754 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.462727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-envoy\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.462950 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.462930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-podinfo\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.468495 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.468474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-token\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.468667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.468650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knt8n\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-kube-api-access-knt8n\") pod \"e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") " pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.620527 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.620493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:29.781053 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.781022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"]
Aug 04 12:19:29.782388 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:19:29.782345    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1a6d89_f813_43b8_8c5e_32f7c45cd7d2.slice/crio-ab50876ad09ee914300023d48ba6d2e4aaac6b78ac52de076b23ee5ea99c4dcc WatchSource:0}: Error finding container ab50876ad09ee914300023d48ba6d2e4aaac6b78ac52de076b23ee5ea99c4dcc: Status 404 returned error can't find the container with id ab50876ad09ee914300023d48ba6d2e4aaac6b78ac52de076b23ee5ea99c4dcc
Aug 04 12:19:29.784635 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.784595    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:29.784755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.784666    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:29.784755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.784694    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:29.844032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:29.843990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" event={"ID":"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2","Type":"ContainerStarted","Data":"ab50876ad09ee914300023d48ba6d2e4aaac6b78ac52de076b23ee5ea99c4dcc"}
Aug 04 12:19:30.850914 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:30.850879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" event={"ID":"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2","Type":"ContainerStarted","Data":"581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"}
Aug 04 12:19:30.874196 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:30.874136    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podStartSLOduration=1.874119695 podStartE2EDuration="1.874119695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:19:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:19:30.872807856 +0000 UTC m=+2779.047293859" watchObservedRunningTime="2026-08-04 12:19:30.874119695 +0000 UTC m=+2779.048605697"
Aug 04 12:19:31.621319 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:31.621281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:31.627118 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:31.627088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:31.856427 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:31.856387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:31.857431 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:31.857391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:32.646665 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:32.646625    2582 patch_prober.go:28] interesting pod/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:19:32.646846 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:32.646686    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:19:33.670436 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.670397    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:19:33.804454 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-envoy\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804454 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-certs\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804454 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804429    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-podinfo\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804490    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-data\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804515    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7pbg\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-kube-api-access-b7pbg\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-token\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804615    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-credential-socket\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804641    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/719224c6-c1f8-4cff-961d-43f9e3bee566-istiod-ca-cert\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-socket\") pod \"719224c6-c1f8-4cff-961d-43f9e3bee566\" (UID: \"719224c6-c1f8-4cff-961d-43f9e3bee566\") "
Aug 04 12:19:33.804769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:33.805135 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.804913    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:33.805135 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.805007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-data" (OuterVolumeSpecName: "istio-data") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:33.805135 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.805081    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.805135 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.805101    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.805316 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.805159    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:33.805316 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.805090    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/719224c6-c1f8-4cff-961d-43f9e3bee566-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:19:33.806721 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.806697    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-token" (OuterVolumeSpecName: "istio-token") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:19:33.806823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.806744    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:19:33.807106 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.807089    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-kube-api-access-b7pbg" (OuterVolumeSpecName: "kube-api-access-b7pbg") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "kube-api-access-b7pbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:19:33.807147 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.807111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "719224c6-c1f8-4cff-961d-43f9e3bee566" (UID: "719224c6-c1f8-4cff-961d-43f9e3bee566"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:19:33.868565 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.868526    2582 generic.go:356] "Generic (PLEG): container finished" podID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerID="a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029" exitCode=0
Aug 04 12:19:33.868737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.868575    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"
Aug 04 12:19:33.868737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.868622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" event={"ID":"719224c6-c1f8-4cff-961d-43f9e3bee566","Type":"ContainerDied","Data":"a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029"}
Aug 04 12:19:33.868737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.868669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n" event={"ID":"719224c6-c1f8-4cff-961d-43f9e3bee566","Type":"ContainerDied","Data":"b5821b7d0ce4355771291a5e0bb1f97ac133747821073527a6d02c889ab74fd9"}
Aug 04 12:19:33.868737 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.868694    2582 scope.go:117] "RemoveContainer" containerID="a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029"
Aug 04 12:19:33.881039 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.879866    2582 scope.go:117] "RemoveContainer" containerID="588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"
Aug 04 12:19:33.894275 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.894245    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"]
Aug 04 12:19:33.895562 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.895538    2582 scope.go:117] "RemoveContainer" containerID="a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029"
Aug 04 12:19:33.895834 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:19:33.895815    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029\": container with ID starting with a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029 not found: ID does not exist" containerID="a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029"
Aug 04 12:19:33.895907 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.895844    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029"} err="failed to get container status \"a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029\": rpc error: code = NotFound desc = could not find container \"a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029\": container with ID starting with a2cbe7dad4585d4dd05d1e60264fe6412fe31d8b1208666264ec5d6c3c1b2029 not found: ID does not exist"
Aug 04 12:19:33.895907 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.895867    2582 scope.go:117] "RemoveContainer" containerID="588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"
Aug 04 12:19:33.896162 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:19:33.896142    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab\": container with ID starting with 588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab not found: ID does not exist" containerID="588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"
Aug 04 12:19:33.896216 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.896168    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab"} err="failed to get container status \"588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab\": rpc error: code = NotFound desc = could not find container \"588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab\": container with ID starting with 588d2b98468c5cf0c50125b4626ae991a93f53880bb97835facc866df8fcbdab not found: ID does not exist"
Aug 04 12:19:33.900915 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.900891    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9e17b5-openshift-default-744c4bd55b-sn77n"]
Aug 04 12:19:33.906109 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906084    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.906224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906114    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/719224c6-c1f8-4cff-961d-43f9e3bee566-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.906224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906130    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.906224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906141    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.906224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906154    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.906224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906165    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/719224c6-c1f8-4cff-961d-43f9e3bee566-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:33.906224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:33.906174    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7pbg\" (UniqueName: \"kubernetes.io/projected/719224c6-c1f8-4cff-961d-43f9e3bee566-kube-api-access-b7pbg\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:19:34.351972 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:34.351877    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" path="/var/lib/kubelet/pods/719224c6-c1f8-4cff-961d-43f9e3bee566/volumes"
Aug 04 12:19:37.318947 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:37.318904    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:19:47.146600 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.145813    2582 patch_prober.go:28] interesting pod/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:52408->10.134.0.60:15021: read: connection reset by peer" start-of-body=
Aug 04 12:19:47.146600 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.145886    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:52408->10.134.0.60:15021: read: connection reset by peer"
Aug 04 12:19:47.950976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.950939    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerID="581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da" exitCode=0
Aug 04 12:19:47.951198 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.950987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" event={"ID":"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2","Type":"ContainerDied","Data":"581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"}
Aug 04 12:19:47.951482 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.951463    2582 scope.go:117] "RemoveContainer" containerID="581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"
Aug 04 12:19:47.952575 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.952540    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:47.952673 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.952631    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:47.952673 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:47.952664    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:48.963238 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:48.963198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" event={"ID":"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2","Type":"ContainerStarted","Data":"5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec"}
Aug 04 12:19:49.621014 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:49.620972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:49.621214 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:49.621168    2582 patch_prober.go:28] interesting pod/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Aug 04 12:19:49.621273 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:49.621216    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Aug 04 12:19:50.621263 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:50.621220    2582 patch_prober.go:28] interesting pod/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Aug 04 12:19:50.621772 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:50.621290    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Aug 04 12:19:51.621862 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:51.621820    2582 patch_prober.go:28] interesting pod/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Aug 04 12:19:51.622285 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:51.621883    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Aug 04 12:19:52.621586 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:52.621540    2582 patch_prober.go:28] interesting pod/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Aug 04 12:19:52.621772 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:52.621602    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Aug 04 12:19:53.620950 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:53.620911    2582 patch_prober.go:28] interesting pod/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Aug 04 12:19:53.621390 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:53.620970    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Aug 04 12:19:54.624999 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:54.624968    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:54.625456 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:54.625279    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:54.626115 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:54.626098    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:19:58.526315 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526277    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"]
Aug 04 12:19:58.526897 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526881    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy"
Aug 04 12:19:58.526942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526900    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy"
Aug 04 12:19:58.526942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526917    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy"
Aug 04 12:19:58.526942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526925    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f262ed76-6e00-44c3-93a0-bc0b4bbe0c88" containerName="istio-proxy"
Aug 04 12:19:58.527085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526944    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy"
Aug 04 12:19:58.527085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.526953    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy"
Aug 04 12:19:58.527085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.527051    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy"
Aug 04 12:19:58.527085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.527065    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="719224c6-c1f8-4cff-961d-43f9e3bee566" containerName="istio-proxy"
Aug 04 12:19:58.530560 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.530537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.532596 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.532575    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-038ca6-openshift-default-dockercfg-65sp2\""
Aug 04 12:19:58.536617 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b0856b7-ee98-4213-a34b-eff637ad4780-istiod-ca-cert\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.536750 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-certs\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.536750 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-credential-socket\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.536750 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-data\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.536921 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-podinfo\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.536921 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-socket\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.536921 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4gw2\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-kube-api-access-b4gw2\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.537071 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-token\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.537071 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.536992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-envoy\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.543266 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.543236    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"]
Aug 04 12:19:58.637879 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.637838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-certs\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.637879 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.637891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-credential-socket\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.638281 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.638241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-data\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.638793 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.638773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-podinfo\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.638956 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.638938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-socket\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639385 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.638691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-credential-socket\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639538 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.638438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-certs\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639638 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.638666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-data\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.639273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-socket\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639832 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.639355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4gw2\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-kube-api-access-b4gw2\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639971 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.639887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-token\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.639971 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.639927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-envoy\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.640092 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.639985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b0856b7-ee98-4213-a34b-eff637ad4780-istiod-ca-cert\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.640767 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.640732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b0856b7-ee98-4213-a34b-eff637ad4780-istiod-ca-cert\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.642031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.641997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-podinfo\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.643056 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.643030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-envoy\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.649235 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.649209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-token\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.654341 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.654282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4gw2\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-kube-api-access-b4gw2\") pod \"e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") " pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.842318 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.842228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:19:58.998670 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:58.998638    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"]
Aug 04 12:19:58.999830 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:19:58.999800    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0856b7_ee98_4213_a34b_eff637ad4780.slice/crio-b91d8eed462f0ea1dc75304febef579db5eeaa1ff06179a3ffb8bca5133658d3 WatchSource:0}: Error finding container b91d8eed462f0ea1dc75304febef579db5eeaa1ff06179a3ffb8bca5133658d3: Status 404 returned error can't find the container with id b91d8eed462f0ea1dc75304febef579db5eeaa1ff06179a3ffb8bca5133658d3
Aug 04 12:19:59.002228 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:59.002189    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:59.002325 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:59.002265    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:59.002325 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:59.002303    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:19:59.022378 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:19:59.022347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" event={"ID":"8b0856b7-ee98-4213-a34b-eff637ad4780","Type":"ContainerStarted","Data":"b91d8eed462f0ea1dc75304febef579db5eeaa1ff06179a3ffb8bca5133658d3"}
Aug 04 12:20:00.029324 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:00.029284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" event={"ID":"8b0856b7-ee98-4213-a34b-eff637ad4780","Type":"ContainerStarted","Data":"fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"}
Aug 04 12:20:00.050859 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:00.050806    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podStartSLOduration=2.050789058 podStartE2EDuration="2.050789058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:20:00.050330073 +0000 UTC m=+2808.224816078" watchObservedRunningTime="2026-08-04 12:20:00.050789058 +0000 UTC m=+2808.225275059"
Aug 04 12:20:00.842843 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:00.842806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:00.847972 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:00.847943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:01.035190 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:01.035159    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:01.036114 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:01.036092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:05.809177 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:05.809138    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:20:16.036968 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.036930    2582 patch_prober.go:28] interesting pod/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 04 12:20:16.037537 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.037011    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 04 12:20:16.128203 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.128168    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerID="fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3" exitCode=0
Aug 04 12:20:16.128392 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.128236    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" event={"ID":"8b0856b7-ee98-4213-a34b-eff637ad4780","Type":"ContainerDied","Data":"fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"}
Aug 04 12:20:16.128704 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.128689    2582 scope.go:117] "RemoveContainer" containerID="fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"
Aug 04 12:20:16.129800 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.129769    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:20:16.129876 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.129858    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:20:16.129929 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:16.129893    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:20:17.136730 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:17.136689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" event={"ID":"8b0856b7-ee98-4213-a34b-eff637ad4780","Type":"ContainerStarted","Data":"0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd"}
Aug 04 12:20:17.843164 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:17.843120    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:17.843614 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:17.843569    2582 patch_prober.go:28] interesting pod/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 04 12:20:17.843865 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:17.843827    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 04 12:20:18.843703 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:18.843655    2582 patch_prober.go:28] interesting pod/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 04 12:20:18.844417 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:18.844369    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 04 12:20:19.842955 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:19.842909    2582 patch_prober.go:28] interesting pod/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 04 12:20:19.843276 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:19.843241    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 04 12:20:20.843620 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:20.843569    2582 patch_prober.go:28] interesting pod/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 04 12:20:20.844153 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:20.843646    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 04 12:20:21.843740 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:21.843690    2582 patch_prober.go:28] interesting pod/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Aug 04 12:20:21.844280 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:21.843780    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Aug 04 12:20:22.846883 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:22.846849    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:22.847375 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:22.847274    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:22.848060 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:22.848040    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:20:38.114547 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:20:38.114509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:21:06.622461 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.622362    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"]
Aug 04 12:21:06.625835 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.625817    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.628083 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.628051    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"kube-root-ca.crt\""
Aug 04 12:21:06.628586 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.628561    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"openshift-service-ca.crt\""
Aug 04 12:21:06.628701 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.628565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"auth-test-model-038ca6-kserve-self-signed-certs\""
Aug 04 12:21:06.628701 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.628658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"default-dockercfg-gjpvc\""
Aug 04 12:21:06.642456 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.642419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"]
Aug 04 12:21:06.727025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.726990    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-tmp-dir\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.727205 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.727034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9c19a-ef84-4e58-9359-c3928e7bd139-tls-certs\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.727205 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.727066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmjl2\" (UniqueName: \"kubernetes.io/projected/17f9c19a-ef84-4e58-9359-c3928e7bd139-kube-api-access-hmjl2\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.727205 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.727093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-dshm\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.727205 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.727168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-model-cache\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.727351 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.727232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-home\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.828627 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.828589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-dshm\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.828823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.828648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-model-cache\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.828823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.828678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-home\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.828823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.828765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-tmp-dir\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.828823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.828800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9c19a-ef84-4e58-9359-c3928e7bd139-tls-certs\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.829046 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.828827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmjl2\" (UniqueName: \"kubernetes.io/projected/17f9c19a-ef84-4e58-9359-c3928e7bd139-kube-api-access-hmjl2\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.829149 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.829124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-model-cache\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.829211 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.829186    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-home\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.829258 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.829220    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-tmp-dir\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.831047 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.831024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-dshm\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.831158 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.831140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9c19a-ef84-4e58-9359-c3928e7bd139-tls-certs\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.838125 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.838103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmjl2\" (UniqueName: \"kubernetes.io/projected/17f9c19a-ef84-4e58-9359-c3928e7bd139-kube-api-access-hmjl2\") pod \"auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") " pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:06.935617 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:06.935515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:07.085283 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:07.085250    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"]
Aug 04 12:21:07.086797 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:21:07.086765    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17f9c19a_ef84_4e58_9359_c3928e7bd139.slice/crio-4723f8e3532b42d48e25748fbc2a4c712854bcfc00815918be99c19ddf8d3471 WatchSource:0}: Error finding container 4723f8e3532b42d48e25748fbc2a4c712854bcfc00815918be99c19ddf8d3471: Status 404 returned error can't find the container with id 4723f8e3532b42d48e25748fbc2a4c712854bcfc00815918be99c19ddf8d3471
Aug 04 12:21:07.432152 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:07.432112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc" event={"ID":"17f9c19a-ef84-4e58-9359-c3928e7bd139","Type":"ContainerStarted","Data":"f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a"}
Aug 04 12:21:07.432340 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:07.432164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc" event={"ID":"17f9c19a-ef84-4e58-9359-c3928e7bd139","Type":"ContainerStarted","Data":"4723f8e3532b42d48e25748fbc2a4c712854bcfc00815918be99c19ddf8d3471"}
Aug 04 12:21:07.450792 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:07.450728    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc" podStartSLOduration=1.450706964 podStartE2EDuration="1.450706964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:21:07.449818294 +0000 UTC m=+2875.624304295" watchObservedRunningTime="2026-08-04 12:21:07.450706964 +0000 UTC m=+2875.625192966"
Aug 04 12:21:09.099162 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:09.099129    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:21:16.936159 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:16.936102    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:16.936717 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:16.936194    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:16.948702 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:16.948678    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:17.499493 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:17.499460    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:21:32.893862 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:32.893820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:21:48.496137 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:48.496100    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:21:58.602026 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:21:58.601985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:22:14.912197 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:22:14.912159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:22:30.563500 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:22:30.563457    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:22:40.805331 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:22:40.805241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:22:57.105361 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:22:57.105324    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:23:12.805620 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:23:12.805579    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:23:23.711934 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:23:23.711880    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:23:39.214212 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:23:39.214167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:23:52.801238 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:23:52.801196    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:24:03.300898 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:24:03.300854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:24:19.302531 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:24:19.302436    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:24:35.097983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:24:35.097937    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:24:45.293658 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:24:45.293615    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:25:01.529818 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:01.529776    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:25:15.300463 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:15.300423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:25:20.182146 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:20.182096    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"]
Aug 04 12:25:25.607514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:25.607476    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:25:35.202077 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.201982    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc" podUID="17f9c19a-ef84-4e58-9359-c3928e7bd139" containerName="main" containerID="cri-o://f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a" gracePeriod=45
Aug 04 12:25:35.460639 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.460571    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:25:35.591628 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.591590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmjl2\" (UniqueName: \"kubernetes.io/projected/17f9c19a-ef84-4e58-9359-c3928e7bd139-kube-api-access-hmjl2\") pod \"17f9c19a-ef84-4e58-9359-c3928e7bd139\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") "
Aug 04 12:25:35.591829 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.591653    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-home\") pod \"17f9c19a-ef84-4e58-9359-c3928e7bd139\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") "
Aug 04 12:25:35.591829 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.591704    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-model-cache\") pod \"17f9c19a-ef84-4e58-9359-c3928e7bd139\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") "
Aug 04 12:25:35.591829 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.591736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-tmp-dir\") pod \"17f9c19a-ef84-4e58-9359-c3928e7bd139\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") "
Aug 04 12:25:35.591829 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.591757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9c19a-ef84-4e58-9359-c3928e7bd139-tls-certs\") pod \"17f9c19a-ef84-4e58-9359-c3928e7bd139\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") "
Aug 04 12:25:35.591829 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.591801    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-dshm\") pod \"17f9c19a-ef84-4e58-9359-c3928e7bd139\" (UID: \"17f9c19a-ef84-4e58-9359-c3928e7bd139\") "
Aug 04 12:25:35.592079 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.592018    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-home" (OuterVolumeSpecName: "home") pod "17f9c19a-ef84-4e58-9359-c3928e7bd139" (UID: "17f9c19a-ef84-4e58-9359-c3928e7bd139"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:25:35.592079 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.592066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-model-cache" (OuterVolumeSpecName: "model-cache") pod "17f9c19a-ef84-4e58-9359-c3928e7bd139" (UID: "17f9c19a-ef84-4e58-9359-c3928e7bd139"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:25:35.592079 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.592052    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "17f9c19a-ef84-4e58-9359-c3928e7bd139" (UID: "17f9c19a-ef84-4e58-9359-c3928e7bd139"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:25:35.592242 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.592204    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-home\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:25:35.592242 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.592215    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-model-cache\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:25:35.592242 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.592227    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-tmp-dir\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:25:35.594005 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.593979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-dshm" (OuterVolumeSpecName: "dshm") pod "17f9c19a-ef84-4e58-9359-c3928e7bd139" (UID: "17f9c19a-ef84-4e58-9359-c3928e7bd139"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:25:35.594085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.594029    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f9c19a-ef84-4e58-9359-c3928e7bd139-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "17f9c19a-ef84-4e58-9359-c3928e7bd139" (UID: "17f9c19a-ef84-4e58-9359-c3928e7bd139"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:25:35.594085 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.594061    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f9c19a-ef84-4e58-9359-c3928e7bd139-kube-api-access-hmjl2" (OuterVolumeSpecName: "kube-api-access-hmjl2") pod "17f9c19a-ef84-4e58-9359-c3928e7bd139" (UID: "17f9c19a-ef84-4e58-9359-c3928e7bd139"). InnerVolumeSpecName "kube-api-access-hmjl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:25:35.692932 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.692873    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9c19a-ef84-4e58-9359-c3928e7bd139-tls-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:25:35.692932 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.692923    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9c19a-ef84-4e58-9359-c3928e7bd139-dshm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:25:35.692932 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.692934    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmjl2\" (UniqueName: \"kubernetes.io/projected/17f9c19a-ef84-4e58-9359-c3928e7bd139-kube-api-access-hmjl2\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:25:35.919418 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.919361    2582 generic.go:356] "Generic (PLEG): container finished" podID="17f9c19a-ef84-4e58-9359-c3928e7bd139" containerID="f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a" exitCode=0
Aug 04 12:25:35.919602 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.919431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc" event={"ID":"17f9c19a-ef84-4e58-9359-c3928e7bd139","Type":"ContainerDied","Data":"f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a"}
Aug 04 12:25:35.919602 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.919445    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"
Aug 04 12:25:35.919602 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.919468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc" event={"ID":"17f9c19a-ef84-4e58-9359-c3928e7bd139","Type":"ContainerDied","Data":"4723f8e3532b42d48e25748fbc2a4c712854bcfc00815918be99c19ddf8d3471"}
Aug 04 12:25:35.919602 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.919488    2582 scope.go:117] "RemoveContainer" containerID="f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a"
Aug 04 12:25:35.929918 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.929892    2582 scope.go:117] "RemoveContainer" containerID="f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a"
Aug 04 12:25:35.930236 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:25:35.930214    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a\": container with ID starting with f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a not found: ID does not exist" containerID="f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a"
Aug 04 12:25:35.930335 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.930243    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a"} err="failed to get container status \"f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a\": rpc error: code = NotFound desc = could not find container \"f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a\": container with ID starting with f7b19b242a9a4ddbd6f8bcae350df02c1c55a61affb42aefd9b071535eaf577a not found: ID does not exist"
Aug 04 12:25:35.942164 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.942128    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"]
Aug 04 12:25:35.945823 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:35.945792    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/auth-test-model-038ca6-kserve-84f9b5cdf9-8wwtc"]
Aug 04 12:25:36.349861 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:36.349829    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f9c19a-ef84-4e58-9359-c3928e7bd139" path="/var/lib/kubelet/pods/17f9c19a-ef84-4e58-9359-c3928e7bd139/volumes"
Aug 04 12:25:46.797760 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:25:46.797703    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:26:00.101620 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.101582    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"]
Aug 04 12:26:00.102097 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.102051    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f9c19a-ef84-4e58-9359-c3928e7bd139" containerName="main"
Aug 04 12:26:00.102097 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.102070    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f9c19a-ef84-4e58-9359-c3928e7bd139" containerName="main"
Aug 04 12:26:00.102187 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.102175    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f9c19a-ef84-4e58-9359-c3928e7bd139" containerName="main"
Aug 04 12:26:00.105382 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.105362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.107990 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.107964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"openshift-service-ca.crt\""
Aug 04 12:26:00.108115 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.108024    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"kube-root-ca.crt\""
Aug 04 12:26:00.108115 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.107964    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"sub-test-model-038ca6-kserve-self-signed-certs\""
Aug 04 12:26:00.108115 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.107970    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-038ca6\"/\"default-dockercfg-gjpvc\""
Aug 04 12:26:00.116987 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.116959    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"]
Aug 04 12:26:00.228634 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.228591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9af10b-0588-4fe1-b748-83722a4c226e-tls-certs\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.228850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.228656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-home\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.228850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.228689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-model-cache\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.228850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.228783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-dshm\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.228850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.228837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-tmp-dir\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.229018 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.228865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7zsv\" (UniqueName: \"kubernetes.io/projected/ba9af10b-0588-4fe1-b748-83722a4c226e-kube-api-access-c7zsv\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330059 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9af10b-0588-4fe1-b748-83722a4c226e-tls-certs\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-home\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-model-cache\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-dshm\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-tmp-dir\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330284 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7zsv\" (UniqueName: \"kubernetes.io/projected/ba9af10b-0588-4fe1-b748-83722a4c226e-kube-api-access-c7zsv\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330602 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-home\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330671 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-model-cache\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.330726 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.330693    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-tmp-dir\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.332477 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.332446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-dshm\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.332720 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.332703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9af10b-0588-4fe1-b748-83722a4c226e-tls-certs\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.338827 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.338805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7zsv\" (UniqueName: \"kubernetes.io/projected/ba9af10b-0588-4fe1-b748-83722a4c226e-kube-api-access-c7zsv\") pod \"sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") " pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.415806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.415709    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:00.560096 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:00.560058    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"]
Aug 04 12:26:00.562352 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:26:00.562317    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba9af10b_0588_4fe1_b748_83722a4c226e.slice/crio-9a383353933c8bcd2b1faef3f2cdb46c2537fed5ebec3e7f2e3cc73107fb9f0e WatchSource:0}: Error finding container 9a383353933c8bcd2b1faef3f2cdb46c2537fed5ebec3e7f2e3cc73107fb9f0e: Status 404 returned error can't find the container with id 9a383353933c8bcd2b1faef3f2cdb46c2537fed5ebec3e7f2e3cc73107fb9f0e
Aug 04 12:26:01.069891 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:01.069851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4" event={"ID":"ba9af10b-0588-4fe1-b748-83722a4c226e","Type":"ContainerStarted","Data":"1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712"}
Aug 04 12:26:01.069891 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:01.069894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4" event={"ID":"ba9af10b-0588-4fe1-b748-83722a4c226e","Type":"ContainerStarted","Data":"9a383353933c8bcd2b1faef3f2cdb46c2537fed5ebec3e7f2e3cc73107fb9f0e"}
Aug 04 12:26:01.089653 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:01.089599    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4" podStartSLOduration=1.089583462 podStartE2EDuration="1.089583462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:26:01.087667597 +0000 UTC m=+3169.262153598" watchObservedRunningTime="2026-08-04 12:26:01.089583462 +0000 UTC m=+3169.264069464"
Aug 04 12:26:02.612742 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:02.612703    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:26:10.416813 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:10.416773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:10.416813 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:10.416821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:10.429400 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:10.429376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:11.135738 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:11.135710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:26:37.409071 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:37.409032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:26:50.704942 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:26:50.704907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:27:02.598196 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:02.598158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:27:09.114102 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:09.114021    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"]
Aug 04 12:27:11.804399 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:11.804360    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:27:24.135173 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.135125    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4" podUID="ba9af10b-0588-4fe1-b748-83722a4c226e" containerName="main" containerID="cri-o://1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712" gracePeriod=45
Aug 04 12:27:24.386723 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.386659    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:27:24.446080 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446045    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-tmp-dir\") pod \"ba9af10b-0588-4fe1-b748-83722a4c226e\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") "
Aug 04 12:27:24.446248 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-model-cache\") pod \"ba9af10b-0588-4fe1-b748-83722a4c226e\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") "
Aug 04 12:27:24.446248 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446127    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7zsv\" (UniqueName: \"kubernetes.io/projected/ba9af10b-0588-4fe1-b748-83722a4c226e-kube-api-access-c7zsv\") pod \"ba9af10b-0588-4fe1-b748-83722a4c226e\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") "
Aug 04 12:27:24.446248 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446202    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-dshm\") pod \"ba9af10b-0588-4fe1-b748-83722a4c226e\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") "
Aug 04 12:27:24.446248 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446241    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-home\") pod \"ba9af10b-0588-4fe1-b748-83722a4c226e\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") "
Aug 04 12:27:24.446512 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446280    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9af10b-0588-4fe1-b748-83722a4c226e-tls-certs\") pod \"ba9af10b-0588-4fe1-b748-83722a4c226e\" (UID: \"ba9af10b-0588-4fe1-b748-83722a4c226e\") "
Aug 04 12:27:24.446512 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ba9af10b-0588-4fe1-b748-83722a4c226e" (UID: "ba9af10b-0588-4fe1-b748-83722a4c226e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:27:24.446512 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446448    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-model-cache" (OuterVolumeSpecName: "model-cache") pod "ba9af10b-0588-4fe1-b748-83722a4c226e" (UID: "ba9af10b-0588-4fe1-b748-83722a4c226e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:27:24.446642 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446566    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-home" (OuterVolumeSpecName: "home") pod "ba9af10b-0588-4fe1-b748-83722a4c226e" (UID: "ba9af10b-0588-4fe1-b748-83722a4c226e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:27:24.446743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446708    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-tmp-dir\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:27:24.446743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446741    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-model-cache\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:27:24.446904 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.446758    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-home\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:27:24.448499 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.448478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-dshm" (OuterVolumeSpecName: "dshm") pod "ba9af10b-0588-4fe1-b748-83722a4c226e" (UID: "ba9af10b-0588-4fe1-b748-83722a4c226e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:27:24.448591 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.448511    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9af10b-0588-4fe1-b748-83722a4c226e-kube-api-access-c7zsv" (OuterVolumeSpecName: "kube-api-access-c7zsv") pod "ba9af10b-0588-4fe1-b748-83722a4c226e" (UID: "ba9af10b-0588-4fe1-b748-83722a4c226e"). InnerVolumeSpecName "kube-api-access-c7zsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:27:24.448591 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.448581    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9af10b-0588-4fe1-b748-83722a4c226e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ba9af10b-0588-4fe1-b748-83722a4c226e" (UID: "ba9af10b-0588-4fe1-b748-83722a4c226e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:27:24.525513 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.525476    2582 generic.go:356] "Generic (PLEG): container finished" podID="ba9af10b-0588-4fe1-b748-83722a4c226e" containerID="1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712" exitCode=0
Aug 04 12:27:24.525513 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.525514    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"
Aug 04 12:27:24.525748 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.525565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4" event={"ID":"ba9af10b-0588-4fe1-b748-83722a4c226e","Type":"ContainerDied","Data":"1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712"}
Aug 04 12:27:24.525748 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.525606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4" event={"ID":"ba9af10b-0588-4fe1-b748-83722a4c226e","Type":"ContainerDied","Data":"9a383353933c8bcd2b1faef3f2cdb46c2537fed5ebec3e7f2e3cc73107fb9f0e"}
Aug 04 12:27:24.525748 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.525624    2582 scope.go:117] "RemoveContainer" containerID="1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712"
Aug 04 12:27:24.535573 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.535553    2582 scope.go:117] "RemoveContainer" containerID="1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712"
Aug 04 12:27:24.535878 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:27:24.535858    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712\": container with ID starting with 1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712 not found: ID does not exist" containerID="1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712"
Aug 04 12:27:24.535971 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.535884    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712"} err="failed to get container status \"1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712\": rpc error: code = NotFound desc = could not find container \"1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712\": container with ID starting with 1b38f72510a13fdfa0e24556de8b90c67e8d9105bdbc4d9958396c8dd8c03712 not found: ID does not exist"
Aug 04 12:27:24.547856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.547833    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9af10b-0588-4fe1-b748-83722a4c226e-dshm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:27:24.547856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.547855    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9af10b-0588-4fe1-b748-83722a4c226e-tls-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:27:24.547992 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.547865    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7zsv\" (UniqueName: \"kubernetes.io/projected/ba9af10b-0588-4fe1-b748-83722a4c226e-kube-api-access-c7zsv\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:27:24.551196 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.551172    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"]
Aug 04 12:27:24.556242 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:24.556219    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-038ca6/sub-test-model-038ca6-kserve-66d4c6df5c-wgtj4"]
Aug 04 12:27:26.350528 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:26.350492    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9af10b-0588-4fe1-b748-83722a4c226e" path="/var/lib/kubelet/pods/ba9af10b-0588-4fe1-b748-83722a4c226e/volumes"
Aug 04 12:27:32.698586 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:27:32.698543    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:28:04.593114 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:28:04.593077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:28:42.205626 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:28:42.205544    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:28:54.836168 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:28:54.836128    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:29:07.605239 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:07.605201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:29:16.197601 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.197563    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:29:16.305245 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.305210    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7470-140200321076784"]
Aug 04 12:29:16.305667 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.305652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9af10b-0588-4fe1-b748-83722a4c226e" containerName="main"
Aug 04 12:29:16.305723 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.305668    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9af10b-0588-4fe1-b748-83722a4c226e" containerName="main"
Aug 04 12:29:16.305762 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.305741    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9af10b-0588-4fe1-b748-83722a4c226e" containerName="main"
Aug 04 12:29:16.308864 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.308848    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:16.311059 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.311038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bcgns\""
Aug 04 12:29:16.317362 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.317331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321076784"]
Aug 04 12:29:16.491798 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.491712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wrgb\" (UniqueName: \"kubernetes.io/projected/a2312973-69b1-4efe-b7ef-2a682577e8c2-kube-api-access-4wrgb\") pod \"test-curl-7470-140200321076784\" (UID: \"a2312973-69b1-4efe-b7ef-2a682577e8c2\") " pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:16.593277 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.593236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wrgb\" (UniqueName: \"kubernetes.io/projected/a2312973-69b1-4efe-b7ef-2a682577e8c2-kube-api-access-4wrgb\") pod \"test-curl-7470-140200321076784\" (UID: \"a2312973-69b1-4efe-b7ef-2a682577e8c2\") " pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:16.602856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.602824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wrgb\" (UniqueName: \"kubernetes.io/projected/a2312973-69b1-4efe-b7ef-2a682577e8c2-kube-api-access-4wrgb\") pod \"test-curl-7470-140200321076784\" (UID: \"a2312973-69b1-4efe-b7ef-2a682577e8c2\") " pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:16.618528 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.618491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:16.759630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.759598    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321076784"]
Aug 04 12:29:16.761893 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:29:16.761852    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2312973_69b1_4efe_b7ef_2a682577e8c2.slice/crio-fe2d343eba5e52ce281fc03ea905c63b578cfbd55c42ab843d466e771c3f46ab WatchSource:0}: Error finding container fe2d343eba5e52ce281fc03ea905c63b578cfbd55c42ab843d466e771c3f46ab: Status 404 returned error can't find the container with id fe2d343eba5e52ce281fc03ea905c63b578cfbd55c42ab843d466e771c3f46ab
Aug 04 12:29:16.763143 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:16.763127    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 12:29:17.136494 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:17.136279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321076784" event={"ID":"a2312973-69b1-4efe-b7ef-2a682577e8c2","Type":"ContainerStarted","Data":"fe2d343eba5e52ce281fc03ea905c63b578cfbd55c42ab843d466e771c3f46ab"}
Aug 04 12:29:18.143360 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:18.143318    2582 generic.go:356] "Generic (PLEG): container finished" podID="a2312973-69b1-4efe-b7ef-2a682577e8c2" containerID="1eba08ca598e5a523c63da6d56eab2f68cbcf29fd3a9d0e6fbe3a1c5728bd688" exitCode=0
Aug 04 12:29:18.143774 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:18.143380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321076784" event={"ID":"a2312973-69b1-4efe-b7ef-2a682577e8c2","Type":"ContainerDied","Data":"1eba08ca598e5a523c63da6d56eab2f68cbcf29fd3a9d0e6fbe3a1c5728bd688"}
Aug 04 12:29:19.286628 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.286603    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:19.316828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.316791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wrgb\" (UniqueName: \"kubernetes.io/projected/a2312973-69b1-4efe-b7ef-2a682577e8c2-kube-api-access-4wrgb\") pod \"a2312973-69b1-4efe-b7ef-2a682577e8c2\" (UID: \"a2312973-69b1-4efe-b7ef-2a682577e8c2\") "
Aug 04 12:29:19.318884 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.318849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2312973-69b1-4efe-b7ef-2a682577e8c2-kube-api-access-4wrgb" (OuterVolumeSpecName: "kube-api-access-4wrgb") pod "a2312973-69b1-4efe-b7ef-2a682577e8c2" (UID: "a2312973-69b1-4efe-b7ef-2a682577e8c2"). InnerVolumeSpecName "kube-api-access-4wrgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:29:19.335339 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.335300    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7470-140200321076784_a2312973-69b1-4efe-b7ef-2a682577e8c2/test-curl-7470-140200321076784/0.log"
Aug 04 12:29:19.366796 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.366762    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7470-140200321076784"]
Aug 04 12:29:19.370588 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.370563    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7470-140200321076784"]
Aug 04 12:29:19.418083 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.417988    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wrgb\" (UniqueName: \"kubernetes.io/projected/a2312973-69b1-4efe-b7ef-2a682577e8c2-kube-api-access-4wrgb\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:29:19.502022 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.501987    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7470-140200321074608"]
Aug 04 12:29:19.502389 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.502375    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2312973-69b1-4efe-b7ef-2a682577e8c2" containerName="test-curl-7470-140200321076784"
Aug 04 12:29:19.502469 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.502390    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2312973-69b1-4efe-b7ef-2a682577e8c2" containerName="test-curl-7470-140200321076784"
Aug 04 12:29:19.502506 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.502493    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2312973-69b1-4efe-b7ef-2a682577e8c2" containerName="test-curl-7470-140200321076784"
Aug 04 12:29:19.505504 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.505485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:19.513189 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.513170    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321074608"]
Aug 04 12:29:19.518458 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.518398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27cv8\" (UniqueName: \"kubernetes.io/projected/f83f440c-1f09-4403-9738-6f22bca3d6bb-kube-api-access-27cv8\") pod \"test-curl-7470-140200321074608\" (UID: \"f83f440c-1f09-4403-9738-6f22bca3d6bb\") " pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:19.618923 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.618882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27cv8\" (UniqueName: \"kubernetes.io/projected/f83f440c-1f09-4403-9738-6f22bca3d6bb-kube-api-access-27cv8\") pod \"test-curl-7470-140200321074608\" (UID: \"f83f440c-1f09-4403-9738-6f22bca3d6bb\") " pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:19.628564 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.628529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27cv8\" (UniqueName: \"kubernetes.io/projected/f83f440c-1f09-4403-9738-6f22bca3d6bb-kube-api-access-27cv8\") pod \"test-curl-7470-140200321074608\" (UID: \"f83f440c-1f09-4403-9738-6f22bca3d6bb\") " pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:19.815986 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.815899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:19.947820 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:19.947795    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321074608"]
Aug 04 12:29:19.949493 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:29:19.949462    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf83f440c_1f09_4403_9738_6f22bca3d6bb.slice/crio-fca11c80da855c93cc38891d3a9b61c3bac2513c78f3f08f239131e2709dfc8c WatchSource:0}: Error finding container fca11c80da855c93cc38891d3a9b61c3bac2513c78f3f08f239131e2709dfc8c: Status 404 returned error can't find the container with id fca11c80da855c93cc38891d3a9b61c3bac2513c78f3f08f239131e2709dfc8c
Aug 04 12:29:20.155107 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:20.155079    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:20.155298 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:20.155090    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe2d343eba5e52ce281fc03ea905c63b578cfbd55c42ab843d466e771c3f46ab"
Aug 04 12:29:20.156270 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:20.156245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321074608" event={"ID":"f83f440c-1f09-4403-9738-6f22bca3d6bb","Type":"ContainerStarted","Data":"fca11c80da855c93cc38891d3a9b61c3bac2513c78f3f08f239131e2709dfc8c"}
Aug 04 12:29:20.176622 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:29:20.176584    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7470-140200321076784\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="a2312973-69b1-4efe-b7ef-2a682577e8c2" pod="opendatahub/test-curl-7470-140200321076784"
Aug 04 12:29:20.349957 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:20.349925    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2312973-69b1-4efe-b7ef-2a682577e8c2" path="/var/lib/kubelet/pods/a2312973-69b1-4efe-b7ef-2a682577e8c2/volumes"
Aug 04 12:29:21.163312 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:21.163272    2582 generic.go:356] "Generic (PLEG): container finished" podID="f83f440c-1f09-4403-9738-6f22bca3d6bb" containerID="e41a86f7b3286e91ca1615e424989937349f4b5283d0e8eb2fa6e5bb01af6488" exitCode=0
Aug 04 12:29:21.163509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:21.163328    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321074608" event={"ID":"f83f440c-1f09-4403-9738-6f22bca3d6bb","Type":"ContainerDied","Data":"e41a86f7b3286e91ca1615e424989937349f4b5283d0e8eb2fa6e5bb01af6488"}
Aug 04 12:29:22.308794 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.308768    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:22.329239 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.329215    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7470-140200321074608_f83f440c-1f09-4403-9738-6f22bca3d6bb/test-curl-7470-140200321074608/0.log"
Aug 04 12:29:22.340564 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.340526    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27cv8\" (UniqueName: \"kubernetes.io/projected/f83f440c-1f09-4403-9738-6f22bca3d6bb-kube-api-access-27cv8\") pod \"f83f440c-1f09-4403-9738-6f22bca3d6bb\" (UID: \"f83f440c-1f09-4403-9738-6f22bca3d6bb\") "
Aug 04 12:29:22.342639 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.342611    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f83f440c-1f09-4403-9738-6f22bca3d6bb-kube-api-access-27cv8" (OuterVolumeSpecName: "kube-api-access-27cv8") pod "f83f440c-1f09-4403-9738-6f22bca3d6bb" (UID: "f83f440c-1f09-4403-9738-6f22bca3d6bb"). InnerVolumeSpecName "kube-api-access-27cv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:29:22.355189 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.355153    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7470-140200321074608"]
Aug 04 12:29:22.359633 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.359596    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7470-140200321074608"]
Aug 04 12:29:22.441459 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.441355    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27cv8\" (UniqueName: \"kubernetes.io/projected/f83f440c-1f09-4403-9738-6f22bca3d6bb-kube-api-access-27cv8\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:29:22.547544 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.547502    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:22.548001 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.547981    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f83f440c-1f09-4403-9738-6f22bca3d6bb" containerName="test-curl-7470-140200321074608"
Aug 04 12:29:22.548001 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.548001    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f83f440c-1f09-4403-9738-6f22bca3d6bb" containerName="test-curl-7470-140200321074608"
Aug 04 12:29:22.548158 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.548091    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f83f440c-1f09-4403-9738-6f22bca3d6bb" containerName="test-curl-7470-140200321074608"
Aug 04 12:29:22.551125 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.551103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:22.556984 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.556954    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:22.643228 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.643190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdw2\" (UniqueName: \"kubernetes.io/projected/1a56b3c4-4105-4872-be89-fe184be3779a-kube-api-access-ptdw2\") pod \"test-curl-7470-140200321232160\" (UID: \"1a56b3c4-4105-4872-be89-fe184be3779a\") " pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:22.744313 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.744218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdw2\" (UniqueName: \"kubernetes.io/projected/1a56b3c4-4105-4872-be89-fe184be3779a-kube-api-access-ptdw2\") pod \"test-curl-7470-140200321232160\" (UID: \"1a56b3c4-4105-4872-be89-fe184be3779a\") " pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:22.753002 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.752974    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdw2\" (UniqueName: \"kubernetes.io/projected/1a56b3c4-4105-4872-be89-fe184be3779a-kube-api-access-ptdw2\") pod \"test-curl-7470-140200321232160\" (UID: \"1a56b3c4-4105-4872-be89-fe184be3779a\") " pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:22.861957 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.861922    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:22.999012 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:22.998984    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:23.000714 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:29:23.000687    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a56b3c4_4105_4872_be89_fe184be3779a.slice/crio-94e738462215d9fb2a617624a40326b45b5468080c941680ca3615c222dd28a1 WatchSource:0}: Error finding container 94e738462215d9fb2a617624a40326b45b5468080c941680ca3615c222dd28a1: Status 404 returned error can't find the container with id 94e738462215d9fb2a617624a40326b45b5468080c941680ca3615c222dd28a1
Aug 04 12:29:23.176110 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:23.176071    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321232160" event={"ID":"1a56b3c4-4105-4872-be89-fe184be3779a","Type":"ContainerStarted","Data":"94e738462215d9fb2a617624a40326b45b5468080c941680ca3615c222dd28a1"}
Aug 04 12:29:23.177216 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:23.177197    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:23.177282 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:23.177215    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fca11c80da855c93cc38891d3a9b61c3bac2513c78f3f08f239131e2709dfc8c"
Aug 04 12:29:23.182168 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:29:23.182135    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7470-140200321074608\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="f83f440c-1f09-4403-9738-6f22bca3d6bb" pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:23.594030 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:23.593946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:29:24.184611 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:24.184577    2582 generic.go:356] "Generic (PLEG): container finished" podID="1a56b3c4-4105-4872-be89-fe184be3779a" containerID="9beb07e783b0185a66ec6e9b8f85e39837f2c46ae6c2a730293afed6d1ceba87" exitCode=0
Aug 04 12:29:24.184824 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:24.184661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321232160" event={"ID":"1a56b3c4-4105-4872-be89-fe184be3779a","Type":"ContainerDied","Data":"9beb07e783b0185a66ec6e9b8f85e39837f2c46ae6c2a730293afed6d1ceba87"}
Aug 04 12:29:24.202499 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:29:24.202464    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7470-140200321074608\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="f83f440c-1f09-4403-9738-6f22bca3d6bb" pod="opendatahub/test-curl-7470-140200321074608"
Aug 04 12:29:24.350540 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:24.350502    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f83f440c-1f09-4403-9738-6f22bca3d6bb" path="/var/lib/kubelet/pods/f83f440c-1f09-4403-9738-6f22bca3d6bb/volumes"
Aug 04 12:29:25.327167 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.327143    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:25.349073 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.349047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7470-140200321232160_1a56b3c4-4105-4872-be89-fe184be3779a/test-curl-7470-140200321232160/0.log"
Aug 04 12:29:25.371278 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.371248    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptdw2\" (UniqueName: \"kubernetes.io/projected/1a56b3c4-4105-4872-be89-fe184be3779a-kube-api-access-ptdw2\") pod \"1a56b3c4-4105-4872-be89-fe184be3779a\" (UID: \"1a56b3c4-4105-4872-be89-fe184be3779a\") "
Aug 04 12:29:25.373316 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.373289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a56b3c4-4105-4872-be89-fe184be3779a-kube-api-access-ptdw2" (OuterVolumeSpecName: "kube-api-access-ptdw2") pod "1a56b3c4-4105-4872-be89-fe184be3779a" (UID: "1a56b3c4-4105-4872-be89-fe184be3779a"). InnerVolumeSpecName "kube-api-access-ptdw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:29:25.378126 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.378099    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:25.385733 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.385710    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:25.472945 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.472857    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptdw2\" (UniqueName: \"kubernetes.io/projected/1a56b3c4-4105-4872-be89-fe184be3779a-kube-api-access-ptdw2\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:29:25.506384 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.506350    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:25.506840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.506814    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a56b3c4-4105-4872-be89-fe184be3779a" containerName="test-curl-7470-140200321232160"
Aug 04 12:29:25.506840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.506834    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a56b3c4-4105-4872-be89-fe184be3779a" containerName="test-curl-7470-140200321232160"
Aug 04 12:29:25.506988 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.506933    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a56b3c4-4105-4872-be89-fe184be3779a" containerName="test-curl-7470-140200321232160"
Aug 04 12:29:25.510035 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.510019    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:25.518254 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.518229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:25.573811 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.573775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b7v5\" (UniqueName: \"kubernetes.io/projected/83d4dc03-a4b8-4fae-862d-55cb1e40cde3-kube-api-access-2b7v5\") pod \"test-curl-7470-140200321232160\" (UID: \"83d4dc03-a4b8-4fae-862d-55cb1e40cde3\") " pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:25.675048 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.675003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b7v5\" (UniqueName: \"kubernetes.io/projected/83d4dc03-a4b8-4fae-862d-55cb1e40cde3-kube-api-access-2b7v5\") pod \"test-curl-7470-140200321232160\" (UID: \"83d4dc03-a4b8-4fae-862d-55cb1e40cde3\") " pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:25.683340 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.683322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b7v5\" (UniqueName: \"kubernetes.io/projected/83d4dc03-a4b8-4fae-862d-55cb1e40cde3-kube-api-access-2b7v5\") pod \"test-curl-7470-140200321232160\" (UID: \"83d4dc03-a4b8-4fae-862d-55cb1e40cde3\") " pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:25.821100 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.821007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:25.959526 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:25.959494    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:25.960537 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:29:25.960508    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83d4dc03_a4b8_4fae_862d_55cb1e40cde3.slice/crio-179931f2d726bc234253736199cfb8742d7f4713c5f4c2b03dc28bb8a69ed9a9 WatchSource:0}: Error finding container 179931f2d726bc234253736199cfb8742d7f4713c5f4c2b03dc28bb8a69ed9a9: Status 404 returned error can't find the container with id 179931f2d726bc234253736199cfb8742d7f4713c5f4c2b03dc28bb8a69ed9a9
Aug 04 12:29:26.197344 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:26.197308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321232160" event={"ID":"83d4dc03-a4b8-4fae-862d-55cb1e40cde3","Type":"ContainerStarted","Data":"179931f2d726bc234253736199cfb8742d7f4713c5f4c2b03dc28bb8a69ed9a9"}
Aug 04 12:29:26.198504 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:26.198485    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94e738462215d9fb2a617624a40326b45b5468080c941680ca3615c222dd28a1"
Aug 04 12:29:26.198504 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:26.198491    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:26.209459 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:26.209425    2582 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7470-140200321232160" oldPodUID="1a56b3c4-4105-4872-be89-fe184be3779a" podUID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3"
Aug 04 12:29:26.350089 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:26.350050    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a56b3c4-4105-4872-be89-fe184be3779a" path="/var/lib/kubelet/pods/1a56b3c4-4105-4872-be89-fe184be3779a/volumes"
Aug 04 12:29:32.232485 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:32.232449    2582 generic.go:356] "Generic (PLEG): container finished" podID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3" containerID="ea71b4656e818d7b40d05d86b9ac11ae13beb34e0b2fc5a9193f90474758dfbf" exitCode=0
Aug 04 12:29:32.232862 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:32.232543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7470-140200321232160" event={"ID":"83d4dc03-a4b8-4fae-862d-55cb1e40cde3","Type":"ContainerDied","Data":"ea71b4656e818d7b40d05d86b9ac11ae13beb34e0b2fc5a9193f90474758dfbf"}
Aug 04 12:29:33.380709 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.380681    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:33.412470 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.412419    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7470-140200321232160_83d4dc03-a4b8-4fae-862d-55cb1e40cde3/test-curl-7470-140200321232160/0.log"
Aug 04 12:29:33.437916 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.437886    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:33.443040 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.443015    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7470-140200321232160"]
Aug 04 12:29:33.452570 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.452551    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b7v5\" (UniqueName: \"kubernetes.io/projected/83d4dc03-a4b8-4fae-862d-55cb1e40cde3-kube-api-access-2b7v5\") pod \"83d4dc03-a4b8-4fae-862d-55cb1e40cde3\" (UID: \"83d4dc03-a4b8-4fae-862d-55cb1e40cde3\") "
Aug 04 12:29:33.454563 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.454532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d4dc03-a4b8-4fae-862d-55cb1e40cde3-kube-api-access-2b7v5" (OuterVolumeSpecName: "kube-api-access-2b7v5") pod "83d4dc03-a4b8-4fae-862d-55cb1e40cde3" (UID: "83d4dc03-a4b8-4fae-862d-55cb1e40cde3"). InnerVolumeSpecName "kube-api-access-2b7v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:29:33.553640 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:33.553558    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b7v5\" (UniqueName: \"kubernetes.io/projected/83d4dc03-a4b8-4fae-862d-55cb1e40cde3-kube-api-access-2b7v5\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:29:34.245176 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:34.245138    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:34.245176 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:34.245176    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="179931f2d726bc234253736199cfb8742d7f4713c5f4c2b03dc28bb8a69ed9a9"
Aug 04 12:29:34.254706 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:29:34.254678    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7470-140200321232160\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" podUID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3" pod="opendatahub/test-curl-7470-140200321232160"
Aug 04 12:29:34.349889 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:34.349859    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3" path="/var/lib/kubelet/pods/83d4dc03-a4b8-4fae-862d-55cb1e40cde3/volumes"
Aug 04 12:29:40.061004 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.060971    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"]
Aug 04 12:29:40.061768 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.061442    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3" containerName="test-curl-7470-140200321232160"
Aug 04 12:29:40.061768 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.061455    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3" containerName="test-curl-7470-140200321232160"
Aug 04 12:29:40.061768 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.061521    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d4dc03-a4b8-4fae-862d-55cb1e40cde3" containerName="test-curl-7470-140200321232160"
Aug 04 12:29:40.064901 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.064881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.067256 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.067235    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a888a4-openshift-default-dockercfg-vgv2x\""
Aug 04 12:29:40.084105 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.084067    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"]
Aug 04 12:29:40.116754 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ltsd\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-kube-api-access-2ltsd\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.116938 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-certs\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.116938 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-socket\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.116938 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istiod-ca-cert\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.116938 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-envoy\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.116938 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-credential-socket\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.116938 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-token\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.117253 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-data\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.117253 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.116997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-podinfo\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218555 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltsd\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-kube-api-access-2ltsd\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-certs\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-socket\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istiod-ca-cert\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-envoy\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-credential-socket\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-token\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-data\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.218983 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.218891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-podinfo\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.219156 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.219044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-certs\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.219309 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.219289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-socket\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.219430 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.219386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istiod-ca-cert\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.219430 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.219395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-credential-socket\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.219614 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.219511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-data\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.221186 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.221158    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-envoy\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.221607 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.221585    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-podinfo\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.226880 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.226857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-token\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.226992 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.226940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ltsd\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-kube-api-access-2ltsd\") pod \"e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") " pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.375246 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.375213    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:40.547249 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.547215    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"]
Aug 04 12:29:40.549484 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:29:40.549451    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d00c247_52cc_43e4_85e9_1f0b374e0eb4.slice/crio-a875163955ed9500aa88a756c2560bae19384e7c535be660bfd14eb377f9164c WatchSource:0}: Error finding container a875163955ed9500aa88a756c2560bae19384e7c535be660bfd14eb377f9164c: Status 404 returned error can't find the container with id a875163955ed9500aa88a756c2560bae19384e7c535be660bfd14eb377f9164c
Aug 04 12:29:40.551905 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.551868    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:29:40.552023 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.551949    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:29:40.552023 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:40.552013    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:29:41.286155 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:41.286121    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" event={"ID":"9d00c247-52cc-43e4-85e9-1f0b374e0eb4","Type":"ContainerStarted","Data":"8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"}
Aug 04 12:29:41.286590 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:41.286171    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" event={"ID":"9d00c247-52cc-43e4-85e9-1f0b374e0eb4","Type":"ContainerStarted","Data":"a875163955ed9500aa88a756c2560bae19384e7c535be660bfd14eb377f9164c"}
Aug 04 12:29:41.350267 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:41.350215    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podStartSLOduration=1.350197923 podStartE2EDuration="1.350197923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:29:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:29:41.34927961 +0000 UTC m=+3389.523765633" watchObservedRunningTime="2026-08-04 12:29:41.350197923 +0000 UTC m=+3389.524684005"
Aug 04 12:29:41.376180 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:41.376152    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:41.381595 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:41.381571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:42.292852 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:42.292821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:42.293872 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:42.293849    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:47.516099 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:47.516067    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:29:57.294755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.294660    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 12:29:57.294755 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.294718    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 12:29:57.398163 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.398131    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerID="8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f" exitCode=0
Aug 04 12:29:57.398336 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.398209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" event={"ID":"9d00c247-52cc-43e4-85e9-1f0b374e0eb4","Type":"ContainerDied","Data":"8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"}
Aug 04 12:29:57.398649 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.398635    2582 scope.go:117] "RemoveContainer" containerID="8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"
Aug 04 12:29:57.399684 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.399662    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:29:57.399743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.399721    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:29:57.399778 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:57.399754    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:29:58.405557 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:58.405527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" event={"ID":"9d00c247-52cc-43e4-85e9-1f0b374e0eb4","Type":"ContainerStarted","Data":"6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994"}
Aug 04 12:29:59.376187 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:59.376151    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:29:59.376380 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:59.376345    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 12:29:59.376462 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:29:59.376392    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 12:30:00.376275 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:00.376238    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 12:30:00.376718 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:00.376305    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 12:30:01.376150 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:01.376112    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 12:30:01.376342 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:01.376166    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 12:30:02.376575 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:02.376534    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Aug 04 12:30:02.377071 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:02.376598    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Aug 04 12:30:03.388536 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:03.388502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:30:03.389024 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:03.388977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:30:03.389614 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:03.389595    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:30:09.683778 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.683689    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"]
Aug 04 12:30:09.688057 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.688032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.691040 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.691013    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-0778c1-openshift-default-dockercfg-g4sr9\""
Aug 04 12:30:09.714379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.714347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"]
Aug 04 12:30:09.737879 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.737827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-certs\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738067 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.737885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmq4p\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-kube-api-access-bmq4p\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738067 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.737919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-podinfo\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738067 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.737966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-envoy\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738211 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.738088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-socket\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738211 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.738131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-data\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738211 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.738184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-token\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738313 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.738252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62187ba1-c110-40db-97b4-a9cee2bd7a87-istiod-ca-cert\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.738313 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.738297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-credential-socket\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839291 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-credential-socket\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-certs\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmq4p\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-kube-api-access-bmq4p\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839514 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-podinfo\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-credential-socket\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839887 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-certs\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.839961 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-envoy\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840014 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.839977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-socket\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840014 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.840003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-data\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840122 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.840054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-token\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840122 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.840117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62187ba1-c110-40db-97b4-a9cee2bd7a87-istiod-ca-cert\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840301 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.840277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-socket\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840577 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.840551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-data\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.840817 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.840796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62187ba1-c110-40db-97b4-a9cee2bd7a87-istiod-ca-cert\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.841834 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.841813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-envoy\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.842141 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.842123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-podinfo\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.848694 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.848669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-token\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.849630 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.849603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmq4p\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-kube-api-access-bmq4p\") pod \"e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") " pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:09.999540 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:09.999440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:10.150651 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.150624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"]
Aug 04 12:30:10.152666 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:30:10.152638    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62187ba1_c110_40db_97b4_a9cee2bd7a87.slice/crio-a17cb1f022f8fdff82d05bd5a90311b7476cfcb175efaab600915f9b5c2cf04d WatchSource:0}: Error finding container a17cb1f022f8fdff82d05bd5a90311b7476cfcb175efaab600915f9b5c2cf04d: Status 404 returned error can't find the container with id a17cb1f022f8fdff82d05bd5a90311b7476cfcb175efaab600915f9b5c2cf04d
Aug 04 12:30:10.154931 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.154894    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:30:10.155032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.154966    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:30:10.155032 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.154997    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:30:10.474004 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.473967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" event={"ID":"62187ba1-c110-40db-97b4-a9cee2bd7a87","Type":"ContainerStarted","Data":"9c0bfdb8d24efe403444b749b9c1cba4857dd64d79335ee545197b5eb244f404"}
Aug 04 12:30:10.474298 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.474026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" event={"ID":"62187ba1-c110-40db-97b4-a9cee2bd7a87","Type":"ContainerStarted","Data":"a17cb1f022f8fdff82d05bd5a90311b7476cfcb175efaab600915f9b5c2cf04d"}
Aug 04 12:30:10.508766 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:10.508712    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" podStartSLOduration=1.508696255 podStartE2EDuration="1.508696255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:30:10.506945488 +0000 UTC m=+3418.681431491" watchObservedRunningTime="2026-08-04 12:30:10.508696255 +0000 UTC m=+3418.683182330"
Aug 04 12:30:11.000421 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:11.000381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:11.006382 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:11.006353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:11.480326 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:11.480293    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:11.481311 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:11.481291    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:30:17.600005 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:17.599958    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:30:44.913731 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:30:44.913696    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pg5l2_0f76cab2-dd3b-4819-9346-df1e24436e07/payload-processing/0.log"
Aug 04 12:31:06.508769 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:31:06.508729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:31:49.589446 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:31:49.589353    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:32:00.650006 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:00.649969    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pg5l2_0f76cab2-dd3b-4819-9346-df1e24436e07/payload-processing/0.log"
Aug 04 12:32:01.327176 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.327144    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"]
Aug 04 12:32:01.330856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.330833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.332977 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.332957    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-672896-openshift-default-dockercfg-w8zsm\""
Aug 04 12:32:01.346018 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.345992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"]
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.440923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-credential-socket\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-certs\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-envoy\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jwk\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-kube-api-access-m5jwk\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-token\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-socket\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istiod-ca-cert\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-podinfo\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.443428 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.441393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-data\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542232 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-podinfo\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542399 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-data\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542399 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-credential-socket\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542399 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-certs\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542594 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-envoy\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542594 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jwk\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-kube-api-access-m5jwk\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542594 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-token\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542594 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-socket\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542821 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istiod-ca-cert\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542821 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-data\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.542821 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-credential-socket\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.543007 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.542987    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-socket\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.543076 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.543038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-certs\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.543517 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.543495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istiod-ca-cert\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.544863 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.544836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-envoy\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.545218 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.545199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-podinfo\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.553813 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.553781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-token\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.553971 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.553951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jwk\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-kube-api-access-m5jwk\") pod \"e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") " pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.645134 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.645103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:01.793775 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.793746    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"]
Aug 04 12:32:01.794631 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:32:01.794608    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac7cf08_6f31_4a5e_b5e8_b0dabbf06f90.slice/crio-fdc195d0e311298cdaac017491669a31be2bb86ff15a571bb28155208a7ff95a WatchSource:0}: Error finding container fdc195d0e311298cdaac017491669a31be2bb86ff15a571bb28155208a7ff95a: Status 404 returned error can't find the container with id fdc195d0e311298cdaac017491669a31be2bb86ff15a571bb28155208a7ff95a
Aug 04 12:32:01.796871 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.796838    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:32:01.796963 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.796905    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:32:01.796963 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:01.796950    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:32:02.144646 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:02.144606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" event={"ID":"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90","Type":"ContainerStarted","Data":"04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"}
Aug 04 12:32:02.144858 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:02.144707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" event={"ID":"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90","Type":"ContainerStarted","Data":"fdc195d0e311298cdaac017491669a31be2bb86ff15a571bb28155208a7ff95a"}
Aug 04 12:32:02.166652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:02.166598    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podStartSLOduration=1.166581469 podStartE2EDuration="1.166581469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:32:02.163321498 +0000 UTC m=+3530.337807500" watchObservedRunningTime="2026-08-04 12:32:02.166581469 +0000 UTC m=+3530.341067471"
Aug 04 12:32:02.645832 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:02.645792    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:02.650934 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:02.650905    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:03.150670 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:03.150639    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:03.151652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:03.151631    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:10.720591 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:10.720552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:32:19.192596 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:19.192546    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 04 12:32:19.193105 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:19.192618    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 04 12:32:21.261343 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:21.261306    2582 generic.go:356] "Generic (PLEG): container finished" podID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerID="04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee" exitCode=0
Aug 04 12:32:21.261804 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:21.261386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" event={"ID":"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90","Type":"ContainerDied","Data":"04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"}
Aug 04 12:32:21.261850 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:21.261808    2582 scope.go:117] "RemoveContainer" containerID="04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"
Aug 04 12:32:21.263154 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:21.263111    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:32:21.263268 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:21.263207    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:32:21.263268 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:21.263256    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 12:32:22.269308 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:22.269273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" event={"ID":"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90","Type":"ContainerStarted","Data":"0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0"}
Aug 04 12:32:22.646377 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:22.646328    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:22.646636 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:22.646487    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Aug 04 12:32:22.646636 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:22.646556    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Aug 04 12:32:23.646657 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:23.646603    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Aug 04 12:32:23.647207 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:23.646697    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Aug 04 12:32:24.645776 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:24.645735    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Aug 04 12:32:24.646088 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:24.646055    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Aug 04 12:32:25.649059 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:25.649017    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Aug 04 12:32:25.649608 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:25.649084    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Aug 04 12:32:26.646256 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:26.646213    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Aug 04 12:32:26.646610 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:26.646575    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Aug 04 12:32:27.650154 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:27.650124    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:27.650646 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:27.650546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:27.651241 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:27.651221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:39.006539 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:39.006502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:32:43.783332 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:43.783299    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"]
Aug 04 12:32:43.783772 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:43.783535    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy" containerID="cri-o://0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0" gracePeriod=30
Aug 04 12:32:49.031748 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.031721    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:49.141814 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.141774    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-envoy\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.141814 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.141817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-token\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142041 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.141849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-credential-socket\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142041 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.141881    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-certs\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142127 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-podinfo\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142127 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-data\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142127 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142117    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:32:49.142287 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142144    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istiod-ca-cert\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142287 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-socket\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142287 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142208    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5jwk\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-kube-api-access-m5jwk\") pod \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\" (UID: \"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90\") "
Aug 04 12:32:49.142287 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142238    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:32:49.142546 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-data" (OuterVolumeSpecName: "istio-data") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:32:49.142606 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142520    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:32:49.142700 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142658    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:32:49.142700 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142691    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.142908 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142711    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.142908 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142726    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.142908 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.142736    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.144264 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.144238    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:32:49.144491 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.144469    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-kube-api-access-m5jwk" (OuterVolumeSpecName: "kube-api-access-m5jwk") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "kube-api-access-m5jwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:32:49.144596 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.144574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:32:49.144643 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.144585    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-token" (OuterVolumeSpecName: "istio-token") pod "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" (UID: "eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:32:49.243743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.243706    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.243743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.243738    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.243743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.243747    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.243743 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.243755    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.244027 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.243764    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5jwk\" (UniqueName: \"kubernetes.io/projected/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90-kube-api-access-m5jwk\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:32:49.422724 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.422631    2582 generic.go:356] "Generic (PLEG): container finished" podID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerID="0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0" exitCode=0
Aug 04 12:32:49.422724 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.422680    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"
Aug 04 12:32:49.422902 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.422715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" event={"ID":"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90","Type":"ContainerDied","Data":"0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0"}
Aug 04 12:32:49.422902 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.422769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489" event={"ID":"eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90","Type":"ContainerDied","Data":"fdc195d0e311298cdaac017491669a31be2bb86ff15a571bb28155208a7ff95a"}
Aug 04 12:32:49.422902 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.422791    2582 scope.go:117] "RemoveContainer" containerID="0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0"
Aug 04 12:32:49.433133 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.433110    2582 scope.go:117] "RemoveContainer" containerID="04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"
Aug 04 12:32:49.442859 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.442834    2582 scope.go:117] "RemoveContainer" containerID="0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0"
Aug 04 12:32:49.443126 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:32:49.443102    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0\": container with ID starting with 0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0 not found: ID does not exist" containerID="0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0"
Aug 04 12:32:49.443219 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.443133    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0"} err="failed to get container status \"0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0\": rpc error: code = NotFound desc = could not find container \"0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0\": container with ID starting with 0e7742479c40759a2f1acfa879bfe3204b8b108c303c10be1d5fe98418ec8dc0 not found: ID does not exist"
Aug 04 12:32:49.443219 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.443152    2582 scope.go:117] "RemoveContainer" containerID="04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"
Aug 04 12:32:49.443427 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:32:49.443384    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee\": container with ID starting with 04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee not found: ID does not exist" containerID="04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"
Aug 04 12:32:49.443509 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.443468    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee"} err="failed to get container status \"04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee\": rpc error: code = NotFound desc = could not find container \"04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee\": container with ID starting with 04f990cafc1255ef92afacf78861ab2582e81b0966134fc88d9f0c1131067dee not found: ID does not exist"
Aug 04 12:32:49.449117 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.449093    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"]
Aug 04 12:32:49.456724 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:49.456702    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-672896-openshift-default-79db7b8cfb-lj489"]
Aug 04 12:32:50.351073 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:32:50.351038    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" path="/var/lib/kubelet/pods/eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90/volumes"
Aug 04 12:33:01.027256 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:01.027217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:33:10.002279 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:10.002246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:33:52.263259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:52.263225    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"]
Aug 04 12:33:52.263796 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:52.263476    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy" containerID="cri-o://6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994" gracePeriod=30
Aug 04 12:33:57.519803 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.519777    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:33:57.629233 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629204    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-socket\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629267    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ltsd\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-kube-api-access-2ltsd\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629298    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-envoy\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629316    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-certs\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629390    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istiod-ca-cert\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-data\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629462    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-token\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629498    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-credential-socket\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629784 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-podinfo\") pod \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\" (UID: \"9d00c247-52cc-43e4-85e9-1f0b374e0eb4\") "
Aug 04 12:33:57.629889 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629820    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:33:57.629945 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.629932    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.630267 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.630208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:33:57.630267 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.630244    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:33:57.630507 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.630288    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:33:57.630573 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.630528    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:33:57.631604 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.631580    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-kube-api-access-2ltsd" (OuterVolumeSpecName: "kube-api-access-2ltsd") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "kube-api-access-2ltsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:33:57.631741 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.631707    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:33:57.631885 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.631866    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:33:57.631973 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.631940    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d00c247-52cc-43e4-85e9-1f0b374e0eb4" (UID: "9d00c247-52cc-43e4-85e9-1f0b374e0eb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:33:57.730927 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730890    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.730927 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730921    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.730927 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730933    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.731182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730945    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ltsd\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-kube-api-access-2ltsd\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.731182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730956    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.731182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730967    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.731182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730977    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.731182 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.730986    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d00c247-52cc-43e4-85e9-1f0b374e0eb4-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:33:57.816058 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.816020    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerID="6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994" exitCode=0
Aug 04 12:33:57.816223 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.816069    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"
Aug 04 12:33:57.816223 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.816111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" event={"ID":"9d00c247-52cc-43e4-85e9-1f0b374e0eb4","Type":"ContainerDied","Data":"6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994"}
Aug 04 12:33:57.816223 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.816162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5" event={"ID":"9d00c247-52cc-43e4-85e9-1f0b374e0eb4","Type":"ContainerDied","Data":"a875163955ed9500aa88a756c2560bae19384e7c535be660bfd14eb377f9164c"}
Aug 04 12:33:57.816223 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.816185    2582 scope.go:117] "RemoveContainer" containerID="6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994"
Aug 04 12:33:57.825972 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.825953    2582 scope.go:117] "RemoveContainer" containerID="8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"
Aug 04 12:33:57.834382 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.834365    2582 scope.go:117] "RemoveContainer" containerID="6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994"
Aug 04 12:33:57.834654 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:33:57.834635    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994\": container with ID starting with 6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994 not found: ID does not exist" containerID="6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994"
Aug 04 12:33:57.834695 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.834663    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994"} err="failed to get container status \"6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994\": rpc error: code = NotFound desc = could not find container \"6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994\": container with ID starting with 6d9a8197defca3c82e507b8e17fb34a60cfc5baff1010c3816e4b3d71785d994 not found: ID does not exist"
Aug 04 12:33:57.834695 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.834680    2582 scope.go:117] "RemoveContainer" containerID="8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"
Aug 04 12:33:57.834917 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:33:57.834900    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f\": container with ID starting with 8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f not found: ID does not exist" containerID="8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"
Aug 04 12:33:57.834954 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.834924    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f"} err="failed to get container status \"8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f\": rpc error: code = NotFound desc = could not find container \"8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f\": container with ID starting with 8be53b1f192c8717e1332240d5e6ba548f988f37041d40aac82be5dbd1b1664f not found: ID does not exist"
Aug 04 12:33:57.839164 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.839141    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"]
Aug 04 12:33:57.843507 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:57.843487    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a888a4-openshift-default-5bcb99d7d6-hp2m5"]
Aug 04 12:33:58.350792 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:33:58.350764    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" path="/var/lib/kubelet/pods/9d00c247-52cc-43e4-85e9-1f0b374e0eb4/volumes"
Aug 04 12:34:05.201495 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:05.201454    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:34:09.966203 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:09.966164    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"]
Aug 04 12:34:09.966727 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:09.966382    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" podUID="62187ba1-c110-40db-97b4-a9cee2bd7a87" containerName="istio-proxy" containerID="cri-o://9c0bfdb8d24efe403444b749b9c1cba4857dd64d79335ee545197b5eb244f404" gracePeriod=30
Aug 04 12:34:11.861097 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:11.861061    2582 patch_prober.go:28] interesting pod/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": read tcp 10.134.0.2:34494->10.134.0.69:15021: read: connection reset by peer" start-of-body=
Aug 04 12:34:11.861541 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:11.861425    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" podUID="62187ba1-c110-40db-97b4-a9cee2bd7a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": read tcp 10.134.0.2:34494->10.134.0.69:15021: read: connection reset by peer"
Aug 04 12:34:11.904887 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:11.904855    2582 generic.go:356] "Generic (PLEG): container finished" podID="62187ba1-c110-40db-97b4-a9cee2bd7a87" containerID="9c0bfdb8d24efe403444b749b9c1cba4857dd64d79335ee545197b5eb244f404" exitCode=0
Aug 04 12:34:11.905035 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:11.904922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" event={"ID":"62187ba1-c110-40db-97b4-a9cee2bd7a87","Type":"ContainerDied","Data":"9c0bfdb8d24efe403444b749b9c1cba4857dd64d79335ee545197b5eb244f404"}
Aug 04 12:34:12.024444 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.024369    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:34:12.074683 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074647    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-certs\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.074854 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074735    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmq4p\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-kube-api-access-bmq4p\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.074854 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074766    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-credential-socket\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.074854 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-data\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.075021 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074862    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-podinfo\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.075021 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-token\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.075021 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074896    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:12.075021 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.074926    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-envoy\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.075233 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075064    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:12.075233 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-data" (OuterVolumeSpecName: "istio-data") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:12.075233 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075149    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62187ba1-c110-40db-97b4-a9cee2bd7a87-istiod-ca-cert\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.075233 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075186    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-socket\") pod \"62187ba1-c110-40db-97b4-a9cee2bd7a87\" (UID: \"62187ba1-c110-40db-97b4-a9cee2bd7a87\") "
Aug 04 12:34:12.075806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075538    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62187ba1-c110-40db-97b4-a9cee2bd7a87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:34:12.075806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075628    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.075806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075646    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.075806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075660    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62187ba1-c110-40db-97b4-a9cee2bd7a87-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.075806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075673    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.075806 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.075759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:12.077246 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.077223    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:34:12.077352 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.077312    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-token" (OuterVolumeSpecName: "istio-token") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:12.077486 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.077465    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:12.077601 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.077537    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-kube-api-access-bmq4p" (OuterVolumeSpecName: "kube-api-access-bmq4p") pod "62187ba1-c110-40db-97b4-a9cee2bd7a87" (UID: "62187ba1-c110-40db-97b4-a9cee2bd7a87"). InnerVolumeSpecName "kube-api-access-bmq4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.176957    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.176984    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.176993    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.177000    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62187ba1-c110-40db-97b4-a9cee2bd7a87-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.177031 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.177009    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmq4p\" (UniqueName: \"kubernetes.io/projected/62187ba1-c110-40db-97b4-a9cee2bd7a87-kube-api-access-bmq4p\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:12.911735 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.911700    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f" event={"ID":"62187ba1-c110-40db-97b4-a9cee2bd7a87","Type":"ContainerDied","Data":"a17cb1f022f8fdff82d05bd5a90311b7476cfcb175efaab600915f9b5c2cf04d"}
Aug 04 12:34:12.911735 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.911727    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"
Aug 04 12:34:12.912224 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.911757    2582 scope.go:117] "RemoveContainer" containerID="9c0bfdb8d24efe403444b749b9c1cba4857dd64d79335ee545197b5eb244f404"
Aug 04 12:34:12.929892 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.929858    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"]
Aug 04 12:34:12.938494 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:12.938470    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-0778c1-openshift-default-c877584d4-smx8f"]
Aug 04 12:34:14.349688 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:14.349657    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62187ba1-c110-40db-97b4-a9cee2bd7a87" path="/var/lib/kubelet/pods/62187ba1-c110-40db-97b4-a9cee2bd7a87/volumes"
Aug 04 12:34:23.009143 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:23.009111    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:34:27.620061 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:27.620028    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"]
Aug 04 12:34:27.620538 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:27.620259    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy" containerID="cri-o://5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec" gracePeriod=30
Aug 04 12:34:32.872013 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.871988    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:34:32.973979 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.973905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-credential-socket\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.973979 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.973951    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-envoy\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.973979 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.973974    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-data\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.973991    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istiod-ca-cert\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974050    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-socket\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974065    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-token\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974091    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-podinfo\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974158    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knt8n\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-kube-api-access-knt8n\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974183    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:32.974259 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-certs\") pod \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\" (UID: \"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2\") "
Aug 04 12:34:32.974729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:32.974729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974426    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:32.974729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974506    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:34:32.974729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974592    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:32.974729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974702    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:32.974729 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974723    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:32.974963 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974735    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:32.974963 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974748    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:32.974963 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.974760    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:32.976159 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.976133    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:32.976286 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.976246    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-kube-api-access-knt8n" (OuterVolumeSpecName: "kube-api-access-knt8n") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "kube-api-access-knt8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:32.976573 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.976549    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:34:32.976653 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:32.976606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" (UID: "8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:33.023856 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.023825    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerID="5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec" exitCode=0
Aug 04 12:34:33.023991 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.023880    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"
Aug 04 12:34:33.023991 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.023908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" event={"ID":"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2","Type":"ContainerDied","Data":"5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec"}
Aug 04 12:34:33.023991 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.023968    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh" event={"ID":"8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2","Type":"ContainerDied","Data":"ab50876ad09ee914300023d48ba6d2e4aaac6b78ac52de076b23ee5ea99c4dcc"}
Aug 04 12:34:33.023991 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.023991    2582 scope.go:117] "RemoveContainer" containerID="5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec"
Aug 04 12:34:33.033915 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.033898    2582 scope.go:117] "RemoveContainer" containerID="581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"
Aug 04 12:34:33.042425 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.042392    2582 scope.go:117] "RemoveContainer" containerID="5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec"
Aug 04 12:34:33.042660 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:34:33.042642    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec\": container with ID starting with 5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec not found: ID does not exist" containerID="5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec"
Aug 04 12:34:33.042711 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.042667    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec"} err="failed to get container status \"5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec\": rpc error: code = NotFound desc = could not find container \"5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec\": container with ID starting with 5226a6aff20bfbc318435ecbbeb1fd3c244dd8cd3cce3f91f081a8aafcdb9aec not found: ID does not exist"
Aug 04 12:34:33.042711 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.042686    2582 scope.go:117] "RemoveContainer" containerID="581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"
Aug 04 12:34:33.042894 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:34:33.042876    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da\": container with ID starting with 581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da not found: ID does not exist" containerID="581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"
Aug 04 12:34:33.042935 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.042899    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da"} err="failed to get container status \"581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da\": rpc error: code = NotFound desc = could not find container \"581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da\": container with ID starting with 581e9b7367778cb092566b2470a4446a07612f30fa4056e4f52a04850b20d1da not found: ID does not exist"
Aug 04 12:34:33.046269 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.046247    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"]
Aug 04 12:34:33.053625 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.053598    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a7013e-openshift-default-7886c8454d-5d7gh"]
Aug 04 12:34:33.076025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.076006    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:33.076025 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.076025    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:33.076142 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.076034    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knt8n\" (UniqueName: \"kubernetes.io/projected/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-kube-api-access-knt8n\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:33.076142 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:33.076044    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:34.350584 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:34.350507    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" path="/var/lib/kubelet/pods/8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2/volumes"
Aug 04 12:34:40.591064 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:40.591028    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-2rccr"]
Aug 04 12:34:46.036391 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:46.036355    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"]
Aug 04 12:34:46.036869 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:46.036628    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy" containerID="cri-o://0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd" gracePeriod=30
Aug 04 12:34:51.288226 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.288201    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:34:51.339386 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b0856b7-ee98-4213-a34b-eff637ad4780-istiod-ca-cert\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339386 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339363    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-socket\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-podinfo\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-token\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339464    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-data\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339615 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4gw2\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-kube-api-access-b4gw2\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339661    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-certs\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:51.339828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-credential-socket\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.339828 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339784    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-envoy\") pod \"8b0856b7-ee98-4213-a34b-eff637ad4780\" (UID: \"8b0856b7-ee98-4213-a34b-eff637ad4780\") "
Aug 04 12:34:51.340059 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339751    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b0856b7-ee98-4213-a34b-eff637ad4780-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:34:51.340059 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.339805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:51.340174 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:51.340174 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340093    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:51.340293 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340196    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b0856b7-ee98-4213-a34b-eff637ad4780-istiod-ca-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.340293 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340218    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.340293 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340226    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-data\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.340293 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340235    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-workload-certs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.340293 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.340246    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-credential-socket\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.341687 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.341666    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:34:51.341799 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.341734    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-kube-api-access-b4gw2" (OuterVolumeSpecName: "kube-api-access-b4gw2") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "kube-api-access-b4gw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:51.341965 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.341949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:51.342019 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.341974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b0856b7-ee98-4213-a34b-eff637ad4780" (UID: "8b0856b7-ee98-4213-a34b-eff637ad4780"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:51.441113 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.441080    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-podinfo\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.441113 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.441108    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.441113 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.441118    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4gw2\" (UniqueName: \"kubernetes.io/projected/8b0856b7-ee98-4213-a34b-eff637ad4780-kube-api-access-b4gw2\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.441336 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.441128    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b0856b7-ee98-4213-a34b-eff637ad4780-istio-envoy\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Aug 04 12:34:51.924358 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:51.924328    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2gtzd_120c24c5-c2ec-497a-ab1c-8a76b34ac829/manager/0.log"
Aug 04 12:34:52.039481 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.039444    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j7w5q_76773db6-360b-463b-bc1d-c7325e965e96/manager/0.log"
Aug 04 12:34:52.127758 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.127720    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerID="0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd" exitCode=0
Aug 04 12:34:52.127899 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.127754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" event={"ID":"8b0856b7-ee98-4213-a34b-eff637ad4780","Type":"ContainerDied","Data":"0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd"}
Aug 04 12:34:52.127899 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.127774    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"
Aug 04 12:34:52.127899 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.127813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5" event={"ID":"8b0856b7-ee98-4213-a34b-eff637ad4780","Type":"ContainerDied","Data":"b91d8eed462f0ea1dc75304febef579db5eeaa1ff06179a3ffb8bca5133658d3"}
Aug 04 12:34:52.127899 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.127835    2582 scope.go:117] "RemoveContainer" containerID="0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd"
Aug 04 12:34:52.139962 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.139933    2582 scope.go:117] "RemoveContainer" containerID="fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"
Aug 04 12:34:52.148483 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.148455    2582 scope.go:117] "RemoveContainer" containerID="0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd"
Aug 04 12:34:52.148793 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:34:52.148768    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd\": container with ID starting with 0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd not found: ID does not exist" containerID="0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd"
Aug 04 12:34:52.148916 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.148802    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd"} err="failed to get container status \"0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd\": rpc error: code = NotFound desc = could not find container \"0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd\": container with ID starting with 0a7243e4e05be141a0a62740d52e758840aa4097236de65f59b0dd9e3bbd4cdd not found: ID does not exist"
Aug 04 12:34:52.148916 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.148827    2582 scope.go:117] "RemoveContainer" containerID="fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"
Aug 04 12:34:52.149183 ip-10-0-129-1 kubenswrapper[2582]: E0804 12:34:52.149165    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3\": container with ID starting with fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3 not found: ID does not exist" containerID="fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"
Aug 04 12:34:52.149258 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.149189    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3"} err="failed to get container status \"fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3\": rpc error: code = NotFound desc = could not find container \"fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3\": container with ID starting with fbf82077ba6f338c06fbdb02293c4409f583bdee80f050c6c7078b71c3b29ca3 not found: ID does not exist"
Aug 04 12:34:52.150830 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.150810    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"]
Aug 04 12:34:52.156562 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.156532    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-038ca6-openshift-default-684685fc4d-2pxn5"]
Aug 04 12:34:52.272859 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.272770    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ck56r_21e96719-9d73-4341-a087-416ee32b90b1/server/0.log"
Aug 04 12:34:52.350074 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.350038    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" path="/var/lib/kubelet/pods/8b0856b7-ee98-4213-a34b-eff637ad4780/volumes"
Aug 04 12:34:52.392277 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.392241    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fdcnd_3c1a7416-6d8e-4461-aca1-25cb07f7ab0f/manager/0.log"
Aug 04 12:34:52.639541 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.639515    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f8dd78b9-sf6wq_ea33c76e-cd9f-4942-8537-4bafd6417fe1/copy-manifests/0.log"
Aug 04 12:34:52.646364 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:52.646340    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f8dd78b9-sf6wq_ea33c76e-cd9f-4942-8537-4bafd6417fe1/manager/0.log"
Aug 04 12:34:53.305424 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:53.305371    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764095-jjpgk_29a2e758-b752-46a7-bc44-f7cbb9be502d/cleanup/0.log"
Aug 04 12:34:54.398617 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:54.398563    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-75z7t_c7f307e7-19f1-4311-8e1a-b13966512533/manager/0.log"
Aug 04 12:34:54.505232 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:54.505201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5s7v4_58ab00c5-c50c-48f8-b18c-ca9323002879/manager/0.log"
Aug 04 12:34:54.826040 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:54.825966    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-2rccr_763124e4-5883-4d53-b0b9-e1b3dc03ee26/limitador/0.log"
Aug 04 12:34:54.938350 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:54.938321    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-f62nh_607102d2-e97a-4315-be2f-13a41aafe5fa/manager/0.log"
Aug 04 12:34:55.264765 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:55.264733    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf_02b7f11b-50d6-4032-9237-27c39446786c/istio-proxy/0.log"
Aug 04 12:34:55.482726 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:55.482696    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-96bfd8458-fkkfp_89a28ef5-88cb-423e-8aa2-c4e03b648122/kube-auth-proxy/0.log"
Aug 04 12:34:55.697943 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:55.697917    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/1.log"
Aug 04 12:34:55.811097 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:55.811068    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lfmh8_f2300f7c-1069-47f7-b3ef-3d84ce71b43f/payload-pre-processing/0.log"
Aug 04 12:34:55.933227 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:55.933201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pg5l2_0f76cab2-dd3b-4819-9346-df1e24436e07/payload-processing/0.log"
Aug 04 12:34:56.487251 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:56.487222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-22plm_a56f5ec7-eb53-41d2-8a04-a6c2aff5d6d2/main/0.log"
Aug 04 12:34:56.917656 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:34:56.917626    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-j89cd_91467b30-b27d-48fc-be2c-2168c53e8c0b/main/0.log"
Aug 04 12:35:01.903002 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.902967    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8l5dn/must-gather-w2c9t"]
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903335    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62187ba1-c110-40db-97b4-a9cee2bd7a87" containerName="istio-proxy"
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903345    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="62187ba1-c110-40db-97b4-a9cee2bd7a87" containerName="istio-proxy"
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903356    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy"
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903362    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy"
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903371    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy"
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903377    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy"
Aug 04 12:35:01.903379 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903383    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903388    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903417    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903423    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903429    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903433    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903446    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903451    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903457    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903462    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903527    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903534    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="62187ba1-c110-40db-97b4-a9cee2bd7a87" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903542    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903547    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903552    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903558    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d00c247-52cc-43e4-85e9-1f0b374e0eb4" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903614    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy"
Aug 04 12:35:01.903652 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903620    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy"
Aug 04 12:35:01.904200 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903673    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1a6d89-f813-43b8-8c5e-32f7c45cd7d2" containerName="istio-proxy"
Aug 04 12:35:01.904200 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903681    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0856b7-ee98-4213-a34b-eff637ad4780" containerName="istio-proxy"
Aug 04 12:35:01.904200 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.903686    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eac7cf08-6f31-4a5e-b5e8-b0dabbf06f90" containerName="istio-proxy"
Aug 04 12:35:01.906491 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.906474    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:01.908834 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.908805    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8l5dn\"/\"kube-root-ca.crt\""
Aug 04 12:35:01.908948 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.908835    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8l5dn\"/\"openshift-service-ca.crt\""
Aug 04 12:35:01.915236 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.915211    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8l5dn/must-gather-w2c9t"]
Aug 04 12:35:01.934050 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.934019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmnd\" (UniqueName: \"kubernetes.io/projected/f441f84b-2c5d-4bdc-8a4b-f1db05010930-kube-api-access-dmmnd\") pod \"must-gather-w2c9t\" (UID: \"f441f84b-2c5d-4bdc-8a4b-f1db05010930\") " pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:01.934185 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:01.934083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f441f84b-2c5d-4bdc-8a4b-f1db05010930-must-gather-output\") pod \"must-gather-w2c9t\" (UID: \"f441f84b-2c5d-4bdc-8a4b-f1db05010930\") " pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:02.034946 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.034909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmnd\" (UniqueName: \"kubernetes.io/projected/f441f84b-2c5d-4bdc-8a4b-f1db05010930-kube-api-access-dmmnd\") pod \"must-gather-w2c9t\" (UID: \"f441f84b-2c5d-4bdc-8a4b-f1db05010930\") " pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:02.035111 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.034969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f441f84b-2c5d-4bdc-8a4b-f1db05010930-must-gather-output\") pod \"must-gather-w2c9t\" (UID: \"f441f84b-2c5d-4bdc-8a4b-f1db05010930\") " pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:02.035303 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.035283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f441f84b-2c5d-4bdc-8a4b-f1db05010930-must-gather-output\") pod \"must-gather-w2c9t\" (UID: \"f441f84b-2c5d-4bdc-8a4b-f1db05010930\") " pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:02.042783 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.042757    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmnd\" (UniqueName: \"kubernetes.io/projected/f441f84b-2c5d-4bdc-8a4b-f1db05010930-kube-api-access-dmmnd\") pod \"must-gather-w2c9t\" (UID: \"f441f84b-2c5d-4bdc-8a4b-f1db05010930\") " pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:02.215918 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.215830    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8l5dn/must-gather-w2c9t"
Aug 04 12:35:02.352953 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.352926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8l5dn/must-gather-w2c9t"]
Aug 04 12:35:02.354290 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:35:02.354267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf441f84b_2c5d_4bdc_8a4b_f1db05010930.slice/crio-2c28f47937f698249acf0aa1fb559b526d2de12a2e19b9b6706f7a89a813b7af WatchSource:0}: Error finding container 2c28f47937f698249acf0aa1fb559b526d2de12a2e19b9b6706f7a89a813b7af: Status 404 returned error can't find the container with id 2c28f47937f698249acf0aa1fb559b526d2de12a2e19b9b6706f7a89a813b7af
Aug 04 12:35:02.356375 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:02.356361    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 12:35:03.190331 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:03.190294    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8l5dn/must-gather-w2c9t" event={"ID":"f441f84b-2c5d-4bdc-8a4b-f1db05010930","Type":"ContainerStarted","Data":"2c28f47937f698249acf0aa1fb559b526d2de12a2e19b9b6706f7a89a813b7af"}
Aug 04 12:35:04.198236 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:04.198195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8l5dn/must-gather-w2c9t" event={"ID":"f441f84b-2c5d-4bdc-8a4b-f1db05010930","Type":"ContainerStarted","Data":"34f5fea5a4969e55131dd490a526cff7110d96033856245d3b6618fdeeedc7e1"}
Aug 04 12:35:04.198638 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:04.198249    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8l5dn/must-gather-w2c9t" event={"ID":"f441f84b-2c5d-4bdc-8a4b-f1db05010930","Type":"ContainerStarted","Data":"413044d2ba12e9ca5d4a7f4748a101f8b24070d559e34d6dff9edc7cbea73d36"}
Aug 04 12:35:04.227011 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:04.226957    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8l5dn/must-gather-w2c9t" podStartSLOduration=2.294930074 podStartE2EDuration="3.226940207s" totalImagesPullingTime="932.010133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:35:04.224832052 +0000 UTC m=+3712.399318053" watchObservedRunningTime="2026-08-04 12:35:04.226940207 +0000 UTC m=+3712.401426209"
Aug 04 12:35:04.963698 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:04.963658    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-chq84_254d88f0-4553-4400-83e1-9210c23a98a7/global-pull-secret-syncer/0.log"
Aug 04 12:35:05.181903 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:05.181868    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8wmgk_ffff1c3e-0a2a-42c8-8e4d-ca71ee8f9ebb/konnectivity-agent/0.log"
Aug 04 12:35:05.230976 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:05.230885    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-1.ec2.internal_b0a1c5c3ab5f0df54822ebe73b3038ef/haproxy/0.log"
Aug 04 12:35:10.109255 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:10.109219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-75z7t_c7f307e7-19f1-4311-8e1a-b13966512533/manager/0.log"
Aug 04 12:35:10.135778 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:10.135742    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5s7v4_58ab00c5-c50c-48f8-b18c-ca9323002879/manager/0.log"
Aug 04 12:35:10.290380 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:10.290345    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-2rccr_763124e4-5883-4d53-b0b9-e1b3dc03ee26/limitador/0.log"
Aug 04 12:35:10.456606 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:10.456517    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-f62nh_607102d2-e97a-4315-be2f-13a41aafe5fa/manager/0.log"
Aug 04 12:35:12.005038 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.005008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/alertmanager/0.log"
Aug 04 12:35:12.037052 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.037005    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/config-reloader/0.log"
Aug 04 12:35:12.075930 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.075898    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/kube-rbac-proxy-web/0.log"
Aug 04 12:35:12.114536 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.114511    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/kube-rbac-proxy/0.log"
Aug 04 12:35:12.147387 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.147359    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/kube-rbac-proxy-metric/0.log"
Aug 04 12:35:12.223104 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.223077    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/prom-label-proxy/0.log"
Aug 04 12:35:12.260873 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.260792    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc992e5d-bc18-43c9-8d33-ba5a19104302/init-config-reloader/0.log"
Aug 04 12:35:12.513840 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.513770    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5cwpt_659b3ef2-501c-4783-88b6-5f22afae8d39/node-exporter/0.log"
Aug 04 12:35:12.555517 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.555490    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5cwpt_659b3ef2-501c-4783-88b6-5f22afae8d39/kube-rbac-proxy/0.log"
Aug 04 12:35:12.600483 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:12.600377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5cwpt_659b3ef2-501c-4783-88b6-5f22afae8d39/init-textfile/0.log"
Aug 04 12:35:13.267894 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:13.267862    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58ffffcfbb-n56sw_a09a0f3a-e004-49f8-8a52-5ceee43f6944/telemeter-client/0.log"
Aug 04 12:35:13.327158 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:13.327119    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58ffffcfbb-n56sw_a09a0f3a-e004-49f8-8a52-5ceee43f6944/reload/0.log"
Aug 04 12:35:13.383424 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:13.382243    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58ffffcfbb-n56sw_a09a0f3a-e004-49f8-8a52-5ceee43f6944/kube-rbac-proxy/0.log"
Aug 04 12:35:14.923496 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:14.923459    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"]
Aug 04 12:35:14.928158 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:14.928108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:14.930299 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:14.930274    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8l5dn\"/\"default-dockercfg-b5kh6\""
Aug 04 12:35:14.977117 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:14.977074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"]
Aug 04 12:35:15.074967 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.074929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-podres\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.075160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.075110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-proc\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.075160 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.075146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-lib-modules\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.075306 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.075174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-sys\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.075306 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.075235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5x7\" (UniqueName: \"kubernetes.io/projected/6194dc14-9163-4f97-a404-e22108eb6450-kube-api-access-2z5x7\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.176611 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5x7\" (UniqueName: \"kubernetes.io/projected/6194dc14-9163-4f97-a404-e22108eb6450-kube-api-access-2z5x7\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.176611 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-podres\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.176846 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-proc\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.176846 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-lib-modules\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.176846 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-sys\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.177022 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-proc\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.177022 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-sys\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.177022 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-podres\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.177022 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.176979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6194dc14-9163-4f97-a404-e22108eb6450-lib-modules\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.186189 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.184705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5x7\" (UniqueName: \"kubernetes.io/projected/6194dc14-9163-4f97-a404-e22108eb6450-kube-api-access-2z5x7\") pod \"perf-node-gather-daemonset-cbtth\" (UID: \"6194dc14-9163-4f97-a404-e22108eb6450\") " pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.243272 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.243238    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:15.438543 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.438457    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"]
Aug 04 12:35:15.446983 ip-10-0-129-1 kubenswrapper[2582]: W0804 12:35:15.446935    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6194dc14_9163_4f97_a404_e22108eb6450.slice/crio-6821f52f37153d12cccccb521b018059903d26de5e8fd522b713be6c9489e759 WatchSource:0}: Error finding container 6821f52f37153d12cccccb521b018059903d26de5e8fd522b713be6c9489e759: Status 404 returned error can't find the container with id 6821f52f37153d12cccccb521b018059903d26de5e8fd522b713be6c9489e759
Aug 04 12:35:15.939718 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:15.939687    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-df5f5fb7c-5hb4n_a62f505a-94f9-44c9-8e04-84a43522bd12/console/0.log"
Aug 04 12:35:16.302666 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:16.302442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth" event={"ID":"6194dc14-9163-4f97-a404-e22108eb6450","Type":"ContainerStarted","Data":"a13544830c5bc6775cb245e9b481d84a9afdc17c53fb1591f9f65748597fe06e"}
Aug 04 12:35:16.302666 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:16.302513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth" event={"ID":"6194dc14-9163-4f97-a404-e22108eb6450","Type":"ContainerStarted","Data":"6821f52f37153d12cccccb521b018059903d26de5e8fd522b713be6c9489e759"}
Aug 04 12:35:16.302666 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:16.302561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:16.318574 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:16.318506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth" podStartSLOduration=2.318483927 podStartE2EDuration="2.318483927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:35:16.316845909 +0000 UTC m=+3724.491331936" watchObservedRunningTime="2026-08-04 12:35:16.318483927 +0000 UTC m=+3724.492969931"
Aug 04 12:35:17.670068 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:17.670044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b2pq4_43c604be-32e1-4b7c-9416-47c671fb1fe7/dns/0.log"
Aug 04 12:35:17.693289 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:17.693262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b2pq4_43c604be-32e1-4b7c-9416-47c671fb1fe7/kube-rbac-proxy/0.log"
Aug 04 12:35:17.857689 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:17.857657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9lmc_83545514-c89f-4911-a801-7baebbb9d89e/dns-node-resolver/0.log"
Aug 04 12:35:18.442283 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:18.442208    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97jv5_48a31f1f-bc82-4402-86b6-26de7ba1d6de/node-ca/0.log"
Aug 04 12:35:19.407628 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:19.407599    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf_02b7f11b-50d6-4032-9237-27c39446786c/istio-proxy/0.log"
Aug 04 12:35:19.605424 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:19.605383    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-96bfd8458-fkkfp_89a28ef5-88cb-423e-8aa2-c4e03b648122/kube-auth-proxy/0.log"
Aug 04 12:35:19.673827 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:19.673753    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/0.log"
Aug 04 12:35:19.682250 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:19.682222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/1.log"
Aug 04 12:35:19.717227 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:19.717178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lfmh8_f2300f7c-1069-47f7-b3ef-3d84ce71b43f/payload-pre-processing/0.log"
Aug 04 12:35:19.752103 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:19.752069    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pg5l2_0f76cab2-dd3b-4819-9346-df1e24436e07/payload-processing/0.log"
Aug 04 12:35:20.634532 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:20.634501    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dwq74_2d64f48b-19e4-4b51-a4be-f04c5291889c/serve-healthcheck-canary/0.log"
Aug 04 12:35:21.313384 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:21.313356    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8jkf_01e07480-1580-44e0-9d74-67f2f47ad017/kube-rbac-proxy/0.log"
Aug 04 12:35:21.334981 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:21.334955    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8jkf_01e07480-1580-44e0-9d74-67f2f47ad017/exporter/0.log"
Aug 04 12:35:21.362524 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:21.362496    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8jkf_01e07480-1580-44e0-9d74-67f2f47ad017/extractor/0.log"
Aug 04 12:35:22.321456 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:22.321393    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8l5dn/perf-node-gather-daemonset-cbtth"
Aug 04 12:35:23.567460 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:23.567434    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2gtzd_120c24c5-c2ec-497a-ab1c-8a76b34ac829/manager/0.log"
Aug 04 12:35:23.926255 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:23.926217    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j7w5q_76773db6-360b-463b-bc1d-c7325e965e96/manager/0.log"
Aug 04 12:35:24.113191 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:24.113151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ck56r_21e96719-9d73-4341-a087-416ee32b90b1/server/0.log"
Aug 04 12:35:24.214482 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:24.214372    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fdcnd_3c1a7416-6d8e-4461-aca1-25cb07f7ab0f/manager/0.log"
Aug 04 12:35:24.303388 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:24.303356    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f8dd78b9-sf6wq_ea33c76e-cd9f-4942-8537-4bafd6417fe1/manager/0.log"
Aug 04 12:35:24.330539 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:24.330506    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f8dd78b9-sf6wq_ea33c76e-cd9f-4942-8537-4bafd6417fe1/copy-manifests/0.log"
Aug 04 12:35:25.611921 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.611886    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf_02b7f11b-50d6-4032-9237-27c39446786c/istio-proxy/0.log"
Aug 04 12:35:25.788328 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.788303    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-96bfd8458-fkkfp_89a28ef5-88cb-423e-8aa2-c4e03b648122/kube-auth-proxy/0.log"
Aug 04 12:35:25.825355 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.825329    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/0.log"
Aug 04 12:35:25.831340 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.831313    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/1.log"
Aug 04 12:35:25.852505 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.852471    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lfmh8_f2300f7c-1069-47f7-b3ef-3d84ce71b43f/payload-pre-processing/0.log"
Aug 04 12:35:25.856744 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.856718    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vl6f7_8c44a5ca-7312-400b-b749-cea3e0e85f94/openshift-lws-operator/0.log"
Aug 04 12:35:25.872779 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:25.872716    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pg5l2_0f76cab2-dd3b-4819-9346-df1e24436e07/payload-processing/0.log"
Aug 04 12:35:27.379156 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:27.379119    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ghkbf_02b7f11b-50d6-4032-9237-27c39446786c/istio-proxy/0.log"
Aug 04 12:35:27.565738 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:27.565660    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-96bfd8458-fkkfp_89a28ef5-88cb-423e-8aa2-c4e03b648122/kube-auth-proxy/0.log"
Aug 04 12:35:27.615000 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:27.614971    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/0.log"
Aug 04 12:35:27.624054 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:27.624020    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p6zbq_a49badea-3e9e-4d50-9ba6-2767ec34a04b/istio-proxy/1.log"
Aug 04 12:35:27.651169 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:27.651133    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-lfmh8_f2300f7c-1069-47f7-b3ef-3d84ce71b43f/payload-pre-processing/0.log"
Aug 04 12:35:27.676918 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:27.676877    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pg5l2_0f76cab2-dd3b-4819-9346-df1e24436e07/payload-processing/0.log"
Aug 04 12:35:31.215734 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:31.215702    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-fj2np_133adc69-b693-4757-b2cb-39f5679ffde3/migrator/0.log"
Aug 04 12:35:31.244838 ip-10-0-129-1 kubenswrapper[2582]: I0804 12:35:31.244813    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-fj2np_133adc69-b693-4757-b2cb-39f5679ffde3/graceful-termination/0.log"